SherbyNet - /page/wikibook/entry.mu

Micron Document

<!DOCTYPE html>

<title>Distributed computing</title>

</head>

Distributed computing

</h1>

</header>

/* start https://en.wikipedia.org/ */

.mw-parser-output .hatnote{font-style:italic}.mw-parser-output div.hatnote{padding-left:1.6em;margin-bottom:0.5em}.mw-parser-output .hatnote i{font-style:normal}.mw-parser-output .hatnote+link+.hatnote{margin-top:-0.5em}@media print{body.ns-0 .mw-parser-output .hatnote{display:none!important}}

/* end https://en.wikipedia.org/ */

</style><div role="note" class="hatnote navigation-not-searchable">Not to be confused with <a href="Decentralized_computing" title="Decentralized computing">Decentralized computing</a>.</div>

Distributed computing is a field of <a href="Computer_science" title="Computer science">computer science</a> that studies distributed systems, defined as <a href="Computer_system" class="mw-redirect" title="Computer system">computer systems</a> whose inter-communicating components are located on different <a href="Computer_network" title="Computer network">networked computers</a>.<a href="#cite_note-tanenbaum-1">[1]</a><a href="#cite_note-Distributed_Programs_2010_pp._373–406-2">[2]</a>

The components of a distributed system communicate and coordinate their actions by <a href="Message_passing" title="Message passing">passing messages</a> to one another in order to achieve a common goal. Three significant challenges of distributed systems are: maintaining <a href="Concurrency_(computer_science)" title="Concurrency (computer science)">concurrency</a> of components, overcoming the <a href="Clock_synchronization" title="Clock synchronization">lack of a global clock</a>, and managing the independent failure of components.<a href="#cite_note-tanenbaum-1">[1]</a> When a component of one system fails, the entire system does not fail.<a href="#cite_note-FOOTNOTEDusseauDusseau20161–2-3">[3]</a> Examples of distributed systems vary from <a href="Service-oriented_architecture" title="Service-oriented architecture">SOA-based systems</a> to <a href="Microservices" title="Microservices">microservices</a> to <a href="Massively_multiplayer_online_game" title="Massively multiplayer online game">massively multiplayer online games</a> to <a href="Peer-to-peer" title="Peer-to-peer">peer-to-peer applications</a>. Distributed systems cost significantly more than monolithic architectures, primarily due to increased needs for additional hardware, servers, gateways, firewalls, new subnets, proxies, and so on.<a href="#cite_note-4">[4]</a> Also, distributed systems are prone to <a href="Fallacies_of_distributed_computing" title="Fallacies of distributed computing">fallacies of distributed computing</a>. On the other hand, a well designed distributed system is more scalable, more durable, more changeable and more fine-tuned than a <a href="Monolithic_application" title="Monolithic application">monolithic application</a> deployed on a single machine.<a href="#cite_note-5">[5]</a> According to Marc Brooker: "a system is scalable in the range where <a href="Marginal_cost" title="Marginal cost">marginal cost</a> of additional workload is nearly constant." <a href="Serverless_computing" title="Serverless computing">Serverless</a> technologies fit this definition but the total cost of ownership, and not just the infra cost must be considered.<a href="#cite_note-6">[6]</a>

A <a href="Computer_program" title="Computer program">computer program</a> that runs within a distributed system is called a distributed program,<a href="#cite_note-Distributed_Programs_2010_pp._373–406_II-7">[7]</a> and distributed programming is the process of writing such programs.<a href="#cite_note-8">[8]</a> There are many different types of implementations for the message passing mechanism, including pure HTTP, <a href="Remote_procedure_call" title="Remote procedure call">RPC-like</a> connectors and <a href="Message-oriented_middleware" title="Message-oriented middleware">message queues</a>.<a href="#cite_note-9">[9]</a>

Distributed computing also refers to the use of distributed systems to solve computational problems. In distributed computing, a problem is divided into many tasks, each of which is solved by one or more computers,<a href="#cite_note-10">[10]</a> which communicate with each other via message passing.<a href="#cite_note-Andrews_2000-11">[11]</a>

<div class="mw-heading mw-heading2"><h2 id="Introduction">Introduction</h2></div>

The word distributed in terms such as "distributed system", "distributed programming", and "<a href="Distributed_algorithm" title="Distributed algorithm">distributed algorithm</a>" originally referred to computer networks where individual computers were physically distributed within some geographical area.<a href="#cite_note-12">[12]</a> The terms are nowadays used in a much wider sense, even referring to autonomous <a href="Process_(computing)" title="Process (computing)">processes</a> that run on the same physical computer and interact with each other by message passing.<a href="#cite_note-Andrews_2000-11">[11]</a>

While there is no single definition of a distributed system,<a href="#cite_note-harvtxt|Ghosh|2007-13">[13]</a> the following defining properties are commonly used as:

<ul><li>There are several autonomous computational entities (computers or <a href="Node_(networking)" title="Node (networking)">nodes</a>), each of which has its own local <a href="Memory_(computers)" class="mw-redirect" title="Memory (computers)">memory</a>.<a href="#cite_note-14">[14]</a></li>

<li>The entities communicate with each other by <a href="Message_passing" title="Message passing">message passing</a>.<a href="#cite_note-15">[15]</a></li></ul>

A distributed system may have a common goal, such as solving a large computational problem;<a href="#cite_note-16">[16]</a> the user then perceives the collection of autonomous processors as a unit. Alternatively, each computer may have its own user with individual needs, and the purpose of the distributed system is to coordinate the use of shared resources or provide communication services to the users.<a href="#cite_note-17">[17]</a>

Other typical properties of distributed systems include the following:

<ul><li>The system has to <a href="Fault_tolerance" title="Fault tolerance">tolerate failures</a> in individual computers.<a href="#cite_note-18">[18]</a></li>

<li>The structure of the system (network topology, network latency, number of computers) is not known in advance, the system may consist of different kinds of computers and network links, and the system may change during the execution of a distributed program.<a href="#cite_note-19">[19]</a></li>

<li>Each computer has only a limited, incomplete view of the system. Each computer may know only one part of the input.<a href="#cite_note-20">[20]</a></li></ul>

<div class="mw-heading mw-heading2"><h2 id="Patterns">Patterns</h2></div>

Here are common <a href="Architectural_patterns" class="mw-redirect" title="Architectural patterns">architectural patterns</a> used for distributed computing:<a href="#cite_note-21">[21]</a>

<ul><li><a href="Saga_interaction_pattern" class="mw-redirect" title="Saga interaction pattern">Saga interaction pattern</a></li>

<li><a href="Microservices" title="Microservices">Microservices</a></li>

<li><a href="Event_driven_architecture" class="mw-redirect" title="Event driven architecture">Event driven architecture</a></li></ul>

<div class="mw-heading mw-heading2"><h2 id="Events_vs._Messages">Events vs. Messages</h2></div>

In distributed systems, <a href="Event_(computing)" title="Event (computing)">events</a> represent a fact or state change (e.g., OrderPlaced) and are typically broadcast asynchronously to multiple consumers, promoting loose coupling and scalability. While events generally don’t expect an immediate response, acknowledgment mechanisms are often implemented at the infrastructure level (e.g., Kafka commit offsets, SNS delivery statuses) rather than being an inherent part of the event pattern itself. <a href="#cite_note-:1-22">[22]</a><a href="#cite_note-:2-23">[23]</a>

In contrast, <a href="Message" title="Message">messages</a> serve a broader role, encompassing commands (e.g., ProcessPayment), events (e.g., PaymentProcessed), and documents (e.g., DataPayload). Both events and messages can support various delivery guarantees, including at-least-once, at-most-once, and exactly-once, depending on the technology stack and implementation. However, exactly-once delivery is often achieved through idempotency mechanisms rather than true, infrastructure-level exactly-once semantics. <a href="#cite_note-:1-22">[22]</a><a href="#cite_note-:2-23">[23]</a>

Delivery patterns for both events and messages include publish/subscribe (one-to-many) and point-to-point (one-to-one). While request/reply is technically possible, it is more commonly associated with messaging patterns rather than pure event-driven systems. Events excel at state propagation and decoupled notifications, while messages are better suited for command execution, workflow orchestration, and explicit coordination. <a href="#cite_note-:1-22">[22]</a><a href="#cite_note-:2-23">[23]</a>

Modern architectures commonly combine both approaches, leveraging events for distributed state change notifications and messages for targeted command execution and structured workflows based on specific timing, ordering, and delivery requirements. <a href="#cite_note-:1-22">[22]</a><a href="#cite_note-:2-23">[23]</a>

<div class="mw-heading mw-heading2"><h2 id="Parallel_and_distributed_computing">Parallel and distributed computing</h2></div>

Distributed systems are groups of networked computers which share a common goal for their work.

The terms "<a href="Concurrent_computing" title="Concurrent computing">concurrent computing</a>", "<a href="Parallel_computing" title="Parallel computing">parallel computing</a>", and "distributed computing" have much overlap, and no clear distinction exists between them.<a href="#cite_note-24">[24]</a> The same system may be characterized both as "parallel" and "distributed"; the processors in a typical distributed system run concurrently in parallel.<a href="#cite_note-25">[25]</a> Parallel computing may be seen as a particularly tightly coupled form of distributed computing,<a href="#cite_note-26">[26]</a> and distributed computing may be seen as a loosely coupled form of parallel computing.<a href="#cite_note-harvtxt|Ghosh|2007-13">[13]</a> Nevertheless, it is possible to roughly classify concurrent systems as "parallel" or "distributed" using the following criteria:

<ul><li>In parallel computing, all processors may have access to a <a href="Shared_memory" title="Shared memory">shared memory</a> to exchange information between processors.<a href="#cite_note-27">[27]</a></li>

<li>In distributed computing, each processor has its own private memory (<a href="Distributed_memory" title="Distributed memory">distributed memory</a>). Information is exchanged by passing messages between the processors.<a href="#cite_note-28">[28]</a></li></ul>

The figure on the right illustrates the difference between distributed and parallel systems. Figure (a) is a schematic view of a typical distributed system; the system is represented as a network topology in which each node is a computer and each line connecting the nodes is a communication link. Figure (b) shows the same distributed system in more detail: each computer has its own local memory, and information can be exchanged only by passing messages from one node to another by using the available communication links. Figure (c) shows a parallel system in which each processor has a direct access to a shared memory.

The situation is further complicated by the traditional uses of the terms parallel and distributed algorithm that do not quite match the above definitions of parallel and distributed systems (see <a href="#Theoretical_foundations">below</a> for more detailed discussion). Nevertheless, as a rule of thumb, high-performance parallel computation in a shared-memory multiprocessor uses parallel algorithms while the coordination of a large-scale distributed system uses distributed algorithms.<a href="#cite_note-BetalebParallel16-29">[29]</a>

<div class="mw-heading mw-heading2"><h2 id="History">History</h2></div>

The use of concurrent processes which communicate through message-passing has its roots in <a href="Operating_system" title="Operating system">operating system</a> architectures studied in the 1960s.<a href="#cite_note-30">[30]</a> The first widespread distributed systems were <a href="Local-area_networks" class="mw-redirect" title="Local-area networks">local-area networks</a> such as <a href="Ethernet" title="Ethernet">Ethernet</a>, which was invented in the 1970s.<a href="#cite_note-31">[31]</a>

<a href="ARPANET" title="ARPANET">ARPANET</a>, one of the predecessors of the <a href="Internet" title="Internet">Internet</a>, was introduced in the late 1960s, and ARPANET <a href="E-mail" class="mw-redirect" title="E-mail">e-mail</a> was invented in the early 1970s. E-mail became the most successful application of ARPANET,<a href="#cite_note-32">[32]</a> and it is probably the earliest example of a large-scale <a href="Distributed_application" class="mw-redirect" title="Distributed application">distributed application</a>. In addition to ARPANET (and its successor, the global Internet), other early worldwide computer networks included <a href="Usenet" title="Usenet">Usenet</a> and <a href="FidoNet" title="FidoNet">FidoNet</a> from the 1980s, both of which were used to support distributed discussion systems.<a href="#cite_note-BanksOnThe12-33">[33]</a>

The study of distributed computing became its own branch of computer science in the late 1970s and early 1980s. The first conference in the field, <a href="Symposium_on_Principles_of_Distributed_Computing" title="Symposium on Principles of Distributed Computing">Symposium on Principles of Distributed Computing</a> (PODC), dates back to 1982, and its counterpart <a href="International_Symposium_on_Distributed_Computing" title="International Symposium on Distributed Computing">International Symposium on Distributed Computing</a> (DISC) was first held in Ottawa in 1985 as the International Workshop on Distributed Algorithms on Graphs.<a href="#cite_note-TelIntro00-34">[34]</a>

<div class="mw-heading mw-heading2"><h2 id="Architectures">Architectures</h2></div>

Various hardware and software architectures are used for distributed computing. At a lower level, it is necessary to interconnect multiple CPUs with some sort of network, regardless of whether that network is printed onto a circuit board or made up of loosely coupled devices and cables. At a higher level, it is necessary to interconnect <a href="Process_(computing)" title="Process (computing)">processes</a> running on those CPUs with some sort of <a href="Communication_system" class="mw-redirect" title="Communication system">communication system</a>.<a href="#cite_note-OhlídalEvo06-35">[35]</a>

Whether these CPUs share resources or not determines a first distinction between three types of architecture:

<ul><li><a href="Shared-memory_architecture" title="Shared-memory architecture">Shared memory</a></li>

<li><a href="Shared-disk_architecture" title="Shared-disk architecture">Shared disk</a></li>

<li><a href="Shared_nothing" class="mw-redirect" title="Shared nothing">Shared nothing</a>.</li></ul>

Distributed programming typically falls into one of several basic architectures: <a href="Client%E2%80%93server" class="mw-redirect" title="Client–server">client–server</a>, <a href="Three-tier_(computing)" class="mw-redirect" title="Three-tier (computing)">three-tier</a>, <a href="Multitier_architecture" title="Multitier architecture">n-tier</a>, or <a href="Peer-to-peer" title="Peer-to-peer">peer-to-peer</a>; or categories: <a href="Loose_coupling" title="Loose coupling">loose coupling</a>, or <a href="Computer_cluster" title="Computer cluster">tight coupling</a>.<a href="#cite_note-36">[36]</a>

<ul><li><a href="Client%E2%80%93server" class="mw-redirect" title="Client–server">Client–server</a>: architectures where smart clients contact the server for data then format and display it to the users. Input at the client is committed back to the server when it represents a permanent change.</li>

<li><a href="Three-tier_(computing)" class="mw-redirect" title="Three-tier (computing)">Three-tier</a>: architectures that move the client intelligence to a middle tier so that <a href="Stateless_protocol" title="Stateless protocol">stateless</a> clients can be used. This simplifies application deployment. Most web applications are three-tier.</li>

<li><a href="Multitier_architecture" title="Multitier architecture">n-tier</a>: architectures that refer typically to web applications which further forward their requests to other enterprise services. This type of application is the one most responsible for the success of <a href="Application_server" title="Application server">application servers</a>.</li>

<li><a href="Peer-to-peer" title="Peer-to-peer">Peer-to-peer</a>: architectures where there are no special machines that provide a service or manage the network resources.<a href="#cite_note-Vigna20150127-37">[37]</a>: 227 Instead all responsibilities are uniformly divided among all machines, known as peers. Peers can serve both as clients and as servers.<a href="#cite_note-38">[38]</a> Examples of this architecture include <a href="BitTorrent" title="BitTorrent">BitTorrent</a> and the <a href="Bitcoin_network" class="mw-redirect" title="Bitcoin network">bitcoin network</a>.</li></ul>

Another basic aspect of distributed computing architecture is the method of communicating and coordinating work among concurrent processes. Through various message passing protocols, processes may communicate directly with one another, typically in a main/sub relationship. Alternatively, a <a href="Database-centric_architecture" title="Database-centric architecture">"database-centric" architecture</a> can enable distributed computing to be done without any form of direct <a href="Inter-process_communication" title="Inter-process communication">inter-process communication</a>, by utilizing a shared <a href="Database" title="Database">database</a>.<a href="#cite_note-39">[39]</a> Database-centric architecture in particular provides relational processing analytics in a schematic architecture allowing for live environment relay. This enables distributed computing functions both within and beyond the parameters of a networked database.<a href="#cite_note-40">[40]</a>

<div class="mw-heading mw-heading3"><h3 id="Cell-Based_Architecture">Cell-Based Architecture</h3></div>

Cell-based architecture is a distributed computing approach in which computational resources are organized into self-contained units called cells. Each cell operates independently, processing requests while maintaining scalability, fault isolation, and availability. <a href="#cite_note-:22-41">[41]</a><a href="#cite_note-:3-42">[42]</a><a href="#cite_note-:4-43">[43]</a>

A cell typically consists of multiple services or application components and functions as an autonomous unit. Some implementations replicate entire sets of <a href="Microservices" title="Microservices">services</a> across multiple cells, while others partition workloads between cells. In replicated models, requests may be rerouted to an operational cell if another experiences a failure. This design is intended to enhance system resilience by reducing the impact of localized failures. <a href="#cite_note-:23-44">[44]</a><a href="#cite_note-:32-45">[45]</a><a href="#cite_note-:42-46">[46]</a>

Some implementations employ <a href="Circuit_breaker_design_pattern" title="Circuit breaker design pattern">circuit breakers</a> within and between cells. Within a cell, circuit breakers may be used to prevent cascading failures among services, while inter-cell circuit breakers can isolate failing cells and redirect traffic to those that remain operational. <a href="#cite_note-:24-47">[47]</a><a href="#cite_note-:33-48">[48]</a><a href="#cite_note-:43-49">[49]</a>

Cell-based architecture has been adopted in some large-scale distributed systems, particularly in cloud-native and high-availability environments, where fault isolation and redundancy are key design considerations. Its implementation varies depending on system requirements, infrastructure constraints, and operational objectives. <a href="#cite_note-:25-50">[50]</a><a href="#cite_note-:34-51">[51]</a><a href="#cite_note-:44-52">[52]</a>

<div class="mw-heading mw-heading2"><h2 id="Applications">Applications</h2></div>

Reasons for using distributed systems and distributed computing may include:

<ul><li>The very nature of an application may require the use of a communication network that connects several computers: for example, data produced in one physical location and required in another location.</li>

<li>There are many cases in which the use of a single computer would be possible in principle, but the use of a distributed system is beneficial for practical reasons. For example:

<ul><li>It can allow for much larger storage and memory, faster compute, and higher bandwidth than a single machine.</li>

<li>It can provide more reliability than a non-distributed system, as there is no <a href="Single_point_of_failure" title="Single point of failure">single point of failure</a>. Moreover, a distributed system may be easier to expand and manage than a monolithic uniprocessor system.<a href="#cite_note-53">[53]</a></li>

<li>It may be more cost-efficient to obtain the desired level of performance by using a <a href="Cluster_(computing)" class="mw-redirect" title="Cluster (computing)">cluster</a> of several low-end computers, in comparison with a single high-end computer.</li></ul></li></ul>

<div class="mw-heading mw-heading2"><h2 id="Examples">Examples</h2></div>

Examples of distributed systems and applications of distributed computing include the following:<a href="#cite_note-54">[54]</a>

<ul><li><a href="Telecommunications" title="Telecommunications">telecommunications</a> networks:

<ul><li><a href="Telephone_network" title="Telephone network">telephone networks</a> and <a href="Cellular_network" title="Cellular network">cellular networks</a>,</li>

<li><a href="Computer_network" title="Computer network">computer networks</a> such as the <a href="Internet" title="Internet">Internet</a>,</li>

<li><a href="Wireless_sensor_network" title="Wireless sensor network">wireless sensor networks</a>,</li>

<li><a href="Routing_algorithm" class="mw-redirect" title="Routing algorithm">routing algorithms</a>;</li></ul></li>

<li>network applications:

<ul><li><a href="World_Wide_Web" title="World Wide Web">World Wide Web</a> and <a href="Peer-to-peer_network" class="mw-redirect" title="Peer-to-peer network">peer-to-peer networks</a>,</li>

<li><a href="Massively_multiplayer_online_game" title="Massively multiplayer online game">massively multiplayer online games</a> and <a href="Virtual_reality" title="Virtual reality">virtual reality</a> communities,</li>

<li><a href="Distributed_database" title="Distributed database">distributed databases</a> and <a href="Distributed_database_management_system" class="mw-redirect" title="Distributed database management system">distributed database management systems</a>,</li>

<li><a href="Distributed_file_system" class="mw-redirect" title="Distributed file system">network file systems</a>,</li>

<li>distributed cache such as <a href="Burst_buffer" title="Burst buffer">burst buffers</a>,</li>

<li>distributed information processing systems such as banking systems and airline reservation systems;</li></ul></li>

<li>real-time process control:

<ul><li><a href="Aircraft" title="Aircraft">aircraft</a> control systems,</li>

<li><a href="Industrial_control_system" title="Industrial control system">industrial control systems</a>;</li></ul></li>

<li><a href="Parallel_computation" class="mw-redirect" title="Parallel computation">parallel computation</a>:

<ul><li><a href="Scientific_computing" class="mw-redirect" title="Scientific computing">scientific computing</a>, including <a href="Cluster_computing" class="mw-redirect" title="Cluster computing">cluster computing</a>, <a href="Grid_computing" title="Grid computing">grid computing</a>, <a href="Cloud_computing" title="Cloud computing">cloud computing</a>,<a href="#cite_note-55">[55]</a> and various <a href="List_of_volunteer_computing_projects" title="List of volunteer computing projects">volunteer computing projects</a>,</li>

<li><a href="Distributed_rendering" class="mw-redirect" title="Distributed rendering">distributed rendering</a> in computer graphics.</li></ul></li>

<div class="mw-heading mw-heading2"><h2 id="Reactive_distributed_systems">Reactive distributed systems</h2></div>

According to Reactive Manifesto, reactive distributed systems are responsive, resilient, elastic and message-driven. Subsequently, Reactive systems are more flexible, loosely-coupled and scalable. To make your systems reactive, you are advised to implement Reactive Principles. Reactive Principles are a set of principles and patterns which help to make your cloud native application as well as edge native applications more reactive. <a href="#cite_note-56">[56]</a>

<div class="mw-heading mw-heading2"><h2 id="Theoretical_foundations">Theoretical foundations</h2></div>

<div role="note" class="hatnote navigation-not-searchable">Main article: <a href="Distributed_algorithm" title="Distributed algorithm">Distributed algorithm</a></div>

<div class="mw-heading mw-heading3"><h3 id="Models">Models</h3></div>

Many tasks that we would like to automate by using a computer are of question–answer type: we would like to ask a question and the computer should produce an answer. In <a href="Theoretical_computer_science" title="Theoretical computer science">theoretical computer science</a>, such tasks are called <a href="Computational_problem" title="Computational problem">computational problems</a>. Formally, a computational problem consists of instances together with a solution for each instance. Instances are questions that we can ask, and solutions are desired answers to these questions.

Theoretical computer science seeks to understand which computational problems can be solved by using a computer (<a href="Computability_theory" title="Computability theory">computability theory</a>) and how efficiently (<a href="Computational_complexity_theory" title="Computational complexity theory">computational complexity theory</a>). Traditionally, it is said that a problem can be solved by using a computer if we can design an <a href="Algorithm" title="Algorithm">algorithm</a> that produces a correct solution for any given instance. Such an algorithm can be implemented as a <a href="Computer_program" title="Computer program">computer program</a> that runs on a general-purpose computer: the program reads a problem instance from <a href="Information" title="Information">input</a>, performs some computation, and produces the solution as <a href="Output_(computing)" class="mw-redirect" title="Output (computing)">output</a>. Formalisms such as <a href="Random-access_machine" title="Random-access machine">random-access machines</a> or <a href="Universal_Turing_machine" title="Universal Turing machine">universal Turing machines</a> can be used as abstract models of a sequential general-purpose computer executing such an algorithm.<a href="#cite_note-ToomarianNeural92-57">[57]</a><a href="#cite_note-SavageModels98-58">[58]</a>

The field of concurrent and distributed computing studies similar questions in the case of either multiple computers, or a computer that executes a network of interacting processes: which computational problems can be solved in such a network and how efficiently? However, it is not at all obvious what is meant by "solving a problem" in the case of a concurrent or distributed system: for example, what is the task of the algorithm designer, and what is the concurrent or distributed equivalent of a sequential general-purpose computer?

The discussion below focuses on the case of multiple computers, although many of the issues are the same for concurrent processes running on a single computer.

Three viewpoints are commonly used:

<dl><dt>Parallel algorithms in shared-memory model</dt></dl>

<ul><li>All processors have access to a shared memory. The algorithm designer chooses the program executed by each processor.</li>

<li>One theoretical model is the <a href="Parallel_random-access_machine" class="mw-redirect" title="Parallel random-access machine">parallel random-access machines</a> (PRAM) that are used.<a href="#cite_note-59">[59]</a> However, the classical PRAM model assumes synchronous access to the shared memory.</li>

<li>Shared-memory programs can be extended to distributed systems if the underlying operating system encapsulates the communication between nodes and virtually unifies the memory across all individual systems.</li>

<li>A model that is closer to the behavior of real-world multiprocessor machines and takes into account the use of machine instructions, such as <a href="Compare-and-swap" title="Compare-and-swap">Compare-and-swap</a> (CAS), is that of asynchronous shared memory. There is a wide body of work on this model, a summary of which can be found in the literature.<a href="#cite_note-60">[60]</a><a href="#cite_note-61">[61]</a></li></ul>

<dl><dt>Parallel algorithms in message-passing model</dt></dl>

<ul><li>The algorithm designer chooses the structure of the network, as well as the program executed by each computer.</li>

<li>Models such as <a href="Boolean_circuits" class="mw-redirect" title="Boolean circuits">Boolean circuits</a> and <a href="Sorting_network" title="Sorting network">sorting networks</a> are used.<a href="#cite_note-62">[62]</a> A Boolean circuit can be seen as a computer network: each gate is a computer that runs an extremely simple computer program. Similarly, a sorting network can be seen as a computer network: each comparator is a computer.</li></ul>

<dl><dt>Distributed algorithms in message-passing model</dt></dl>

<ul><li>The algorithm designer only chooses the computer program. All computers run the same program. The system must work correctly regardless of the structure of the network.</li>

<li>A commonly used model is a <a href="Graph_(discrete_mathematics)" title="Graph (discrete mathematics)">graph</a> with one <a href="Finite-state_machine" title="Finite-state machine">finite-state machine</a> per node.</li></ul>

In the case of distributed algorithms, computational problems are typically related to graphs. Often the graph that describes the structure of the computer network is the problem instance. This is illustrated in the following example.<a href="#cite_note-:0-63">[63]</a>

<div class="mw-heading mw-heading3"><h3 id="An_example">An example</h3></div>

Consider the computational problem of finding a coloring of a given graph G. Different fields might take the following approaches:

<dl><dt>Centralized algorithms<a href="#cite_note-:0-63">[63]</a></dt></dl>

<ul><li>The graph G is encoded as a string, and the string is given as input to a computer. The computer program finds a coloring of the graph, encodes the coloring as a string, and outputs the result.</li></ul>

<dl><dt>Parallel algorithms</dt></dl>

<ul><li>Again, the graph G is encoded as a string. However, multiple computers can access the same string in parallel. Each computer might focus on one part of the graph and produce a coloring for that part.</li>

<li>The main focus is on high-performance computation that exploits the processing power of multiple computers in parallel.</li></ul>

<dl><dt>Distributed algorithms</dt></dl>

<ul><li>The graph G is the structure of the computer network. There is one computer for each node of G and one communication link for each edge of G. Initially, each computer only knows about its immediate neighbors in the graph G; the computers must exchange messages with each other to discover more about the structure of G. Each computer must produce its own color as output.</li>

<li>The main focus is on coordinating the operation of an arbitrary distributed system.<a href="#cite_note-:0-63">[63]</a></li></ul>

While the field of parallel algorithms has a different focus than the field of distributed algorithms, there is much interaction between the two fields. For example, the <a href="Cole%E2%80%93Vishkin_algorithm" class="mw-redirect" title="Cole–Vishkin algorithm">Cole–Vishkin algorithm</a> for graph coloring<a href="#cite_note-64">[64]</a> was originally presented as a parallel algorithm, but the same technique can also be used directly as a distributed algorithm.

Moreover, a parallel algorithm can be implemented either in a parallel system (using shared memory) or in a distributed system (using message passing).<a href="#cite_note-65">[65]</a> The traditional boundary between parallel and distributed algorithms (choose a suitable network vs. run in any given network) does not lie in the same place as the boundary between parallel and distributed systems (shared memory vs. message passing).

<div class="mw-heading mw-heading3"><h3 id="Complexity_measures">Complexity measures</h3></div>

In parallel algorithms, yet another resource in addition to time and space is the number of computers. Indeed, often there is a trade-off between the running time and the number of computers: the problem can be solved faster if there are more computers running in parallel (see <a href="Speedup" title="Speedup">speedup</a>). If a decision problem can be solved in <a href="Polylogarithmic_time" class="mw-redirect" title="Polylogarithmic time">polylogarithmic time</a> by using a polynomial number of processors, then the problem is said to be in the class <a href="NC_(complexity)" title="NC (complexity)">NC</a>.<a href="#cite_note-66">[66]</a> The class NC can be defined equally well by using the PRAM formalism or Boolean circuits—PRAM machines can simulate Boolean circuits efficiently and vice versa.<a href="#cite_note-67">[67]</a>

In the analysis of distributed algorithms, more attention is usually paid on communication operations than computational steps. Perhaps the simplest model of distributed computing is a synchronous system where all nodes operate in a lockstep fashion. This model is commonly known as the LOCAL model. During each communication round, all nodes in parallel (1) receive the latest messages from their neighbours, (2) perform arbitrary local computation, and (3) send new messages to their neighbors. In such systems, a central complexity measure is the number of synchronous communication rounds required to complete the task.<a href="#cite_note-68">[68]</a>

This complexity measure is closely related to the <a href="Diameter_(graph_theory)" title="Diameter (graph theory)">diameter</a> of the network. Let D be the diameter of the network. On the one hand, any computable problem can be solved trivially in a synchronous distributed system in approximately 2D communication rounds: simply gather all information in one location (D rounds), solve the problem, and inform each node about the solution (D rounds).

On the other hand, if the running time of the algorithm is much smaller than D communication rounds, then the nodes in the network must produce their output without having the possibility to obtain information about distant parts of the network. In other words, the nodes must make globally consistent decisions based on information that is available in their local D-neighbourhood. Many distributed algorithms are known with the running time much smaller than D rounds, and understanding which problems can be solved by such algorithms is one of the central research questions of the field.<a href="#cite_note-69">[69]</a> Typically an algorithm which solves a problem in polylogarithmic time in the network size is considered efficient in this model.

Another commonly used measure is the total number of bits transmitted in the network (cf. <a href="Communication_complexity" title="Communication complexity">communication complexity</a>).<a href="#cite_note-SchneiderTrading11-70">[70]</a> The features of this concept are typically captured with the CONGEST(B) model, which is similarly defined as the LOCAL model, but where single messages can only contain B bits.

<div class="mw-heading mw-heading3"><h3 id="Other_problems">Other problems</h3></div>

Traditional computational problems take the perspective that the user asks a question, a computer (or a distributed system) processes the question, then produces an answer and stops. However, there are also problems where the system is required not to stop, including the <a href="Dining_philosophers_problem" title="Dining philosophers problem">dining philosophers problem</a> and other similar <a href="Mutual_exclusion" title="Mutual exclusion">mutual exclusion</a> problems. In these problems, the distributed system is supposed to continuously coordinate the use of shared resources so that no conflicts or <a href="Deadlock_(computer_science)" title="Deadlock (computer science)">deadlocks</a> occur.

There are also fundamental challenges that are unique to distributed computing, for example those related to fault-tolerance. Examples of related problems include <a href="Consensus_(computer_science)" title="Consensus (computer science)">consensus problems</a>,<a href="#cite_note-71">[71]</a> <a href="Byzantine_fault_tolerance" class="mw-redirect" title="Byzantine fault tolerance">Byzantine fault tolerance</a>,<a href="#cite_note-72">[72]</a> and <a href="Self-stabilisation" class="mw-redirect" title="Self-stabilisation">self-stabilisation</a>.<a href="#cite_note-73">[73]</a>

Much research is also focused on understanding the asynchronous nature of distributed systems:

<ul><li><a href="Synchronizer_(algorithm)" title="Synchronizer (algorithm)">Synchronizers</a> can be used to run synchronous algorithms in asynchronous systems.<a href="#cite_note-74">[74]</a></li>

<li><a href="Logical_clock" title="Logical clock">Logical clocks</a> provide a causal <a href="Happened-before" title="Happened-before">happened-before</a> ordering of events.<a href="#cite_note-75">[75]</a></li>

<li><a href="Clock_synchronization" title="Clock synchronization">Clock synchronization</a> algorithms provide globally consistent physical time stamps.<a href="#cite_note-76">[76]</a></li></ul>

Note that in distributed systems, <a href="Latency_(engineering)" title="Latency (engineering)">latency</a> should be measured through "99th percentile" because "median" and "average" can be misleading.<a href="#cite_note-77">[77]</a>

<div class="mw-heading mw-heading3"><h3 id="Election"><a href="Leader_election" title="Leader election">Election</a></h3></div>

Coordinator election (or leader election) is the process of designating a single <a href="Process_(computing)" title="Process (computing)">process</a> as the organizer of some task distributed among several computers (nodes). Before the task is begun, all network nodes are either unaware which node will serve as the "coordinator" (or leader) of the task, or unable to communicate with the current coordinator. After a coordinator election algorithm has been run, however, each node throughout the network recognizes a particular, unique node as the task coordinator.<a href="#cite_note-HaloiApache15-78">[78]</a>

The network nodes communicate among themselves in order to decide which of them will get into the "coordinator" state. For that, they need some method in order to break the symmetry among them. For example, if each node has unique and comparable identities, then the nodes can compare their identities, and decide that the node with the highest identity is the coordinator.<a href="#cite_note-HaloiApache15-78">[78]</a>

The definition of this problem is often attributed to <a href="G%C3%A9rard_Le_Lann" title="Gérard Le Lann">LeLann</a>, who formalized it as a method to create a new token in a token <a href="Ring_network" title="Ring network">ring network</a> in which the token has been lost.<a href="#cite_note-79">[79]</a>

Coordinator election algorithms are designed to be economical in terms of total <a href="Byte" title="Byte">bytes</a> transmitted, and time. The algorithm suggested by Gallager, Humblet, and Spira<a href="#cite_note-80">[80]</a> for general undirected graphs has had a strong impact on the design of distributed algorithms in general, and won the <a href="Dijkstra_Prize" class="mw-redirect" title="Dijkstra Prize">Dijkstra Prize</a> for an influential paper in distributed computing.

Many other algorithms were suggested for different kinds of network <a href="Graph_(discrete_mathematics)" title="Graph (discrete mathematics)">graphs</a>, such as undirected rings, unidirectional rings, complete graphs, grids, directed Euler graphs, and others. A general method that decouples the issue of the graph family from the design of the coordinator election algorithm was suggested by Korach, Kutten, and Moran.<a href="#cite_note-81">[81]</a>

In order to perform coordination, distributed systems employ the concept of coordinators. The coordinator election problem is to choose a process from among a group of processes on different processors in a distributed system to act as the central coordinator. Several central coordinator election algorithms exist.<a href="#cite_note-82">[82]</a>

<div class="mw-heading mw-heading3"><h3 id="Properties_of_distributed_systems">Properties of distributed systems</h3></div>

So far the focus has been on designing a distributed system that solves a given problem. A complementary research problem is studying the properties of a given distributed system.<a href="#cite_note-83">[83]</a><a href="#cite_note-84">[84]</a>

The <a href="Halting_problem" title="Halting problem">halting problem</a> is an analogous example from the field of centralised computation: we are given a computer program and the task is to decide whether it halts or runs forever. The halting problem is <a href="Undecidable_problem" title="Undecidable problem">undecidable</a> in the general case, and naturally understanding the behaviour of a computer network is at least as hard as understanding the behaviour of one computer.<a href="#cite_note-SvozilIndet11-85">[85]</a>

However, there are many interesting special cases that are decidable. In particular, it is possible to reason about the behaviour of a network of finite-state machines. One example is telling whether a given network of interacting (asynchronous and non-deterministic) finite-state machines can reach a deadlock. This problem is <a href="PSPACE-complete" title="PSPACE-complete">PSPACE-complete</a>,<a href="#cite_note-86">[86]</a> i.e., it is decidable, but not likely that there is an efficient (centralised, parallel or distributed) algorithm that solves the problem in the case of large networks.

<div class="mw-heading mw-heading3"><h3 id="Other_Topics">Other Topics</h3></div>

<a href="Linearizability" title="Linearizability">Linearizability</a>

/* start https://en.wikipedia.org/ */

.mw-parser-output .div-col{margin-top:0.3em;column-width:30em}.mw-parser-output .div-col-small{font-size:90%}.mw-parser-output .div-col-rules{column-rule:1px solid #aaa}.mw-parser-output .div-col dl,.mw-parser-output .div-col ol,.mw-parser-output .div-col ul{margin-top:0}.mw-parser-output .div-col li,.mw-parser-output .div-col dd{page-break-inside:avoid;break-inside:avoid-column}

/* end https://en.wikipedia.org/ */

</style><div class="div-col" style="column-width: 20em;">

<ul><li><a href="Actor_model" title="Actor model">Actor model</a> – Model of concurrent computation</li>

<li><a href="AppScale" title="AppScale">AppScale</a> – American cloud infrastructure software company</li>

<li><a href="BOINC" class="mw-redirect" title="BOINC">BOINC</a> – Open source middleware system for volunteer and grid computingPages displaying short descriptions of redirect targets</li>

<li><a href="Code_mobility" title="Code mobility">Code mobility</a> – Process in distributed computing</li>

<li><a href="Dataflow_programming" title="Dataflow programming">Dataflow programming</a> – Computer programming paradigm</li>

<li><a href="Decentralized_computing" title="Decentralized computing">Decentralized computing</a> – Distribution of jobs across different computers</li>

<li><a href="Distributed_algorithm" title="Distributed algorithm">Distributed algorithm</a> – Algorithm run on hardware built from interconnected processors</li>

<li><a href="Distributed_algorithmic_mechanism_design" title="Distributed algorithmic mechanism design">Distributed algorithmic mechanism design</a></li>

<li><a href="Distributed_cache" title="Distributed cache">Distributed cache</a> – Type of computer cache</li>

<li><a href="Distributed_GIS" title="Distributed GIS">Distributed GIS</a> – A type of Geographic Information System</li>

<li><a href="Distributed_networking" title="Distributed networking">Distributed networking</a> – Multi-source interconnected computing</li>

<li><a href="Distributed_operating_system" title="Distributed operating system">Distributed operating system</a> – Operating system designed to operate on multiple systems over a network computer</li>

<li><a href="Eventual_consistency" title="Eventual consistency">Eventual consistency</a> – Consistency model used in distributed computing to achieve high availability</li>

<li><a href="Edsger_W._Dijkstra_Prize_in_Distributed_Computing" class="mw-redirect" title="Edsger W. Dijkstra Prize in Distributed Computing">Edsger W. Dijkstra Prize in Distributed Computing</a> – Annual conference on computingPages displaying short descriptions of redirect targets</li>

<li><a href="Federation_(information_technology)" title="Federation (information technology)">Federation (information technology)</a> – Group of network or telecommunication providers agreeing upon interoperability standards</li>

<li><a href="Flat_neighborhood_network" title="Flat neighborhood network">Flat neighborhood network</a></li>

<li><a href="Fog_computing" title="Fog computing">Fog computing</a> – Architecture that uses edge devices</li>

<li><a href="Folding%40home" title="Folding@home">Folding@home</a> – Distributed computing project simulating protein folding</li>

<li><a href="Grid_computing" title="Grid computing">Grid computing</a> – Use of widely distributed computer resources to reach a common goal</li>

<li><a href="Inferno_(operating_system)" title="Inferno (operating system)">Inferno</a> – Distributed operating system</li>

<li><a href="Internet_GIS" title="Internet GIS">Internet GIS</a> – Internet technologies regarding spatial data</li>

<li><a href="Jungle_computing" title="Jungle computing">Jungle computing</a> – Type of distributed computing</li>

<li><a href="Layered_queueing_network" title="Layered queueing network">Layered queueing network</a></li>

<li>Library Oriented Architecture (LOA)</li>

<li><a href="List_of_distributed_computing_conferences" title="List of distributed computing conferences">List of distributed computing conferences</a></li>

<li><a href="List_of_volunteer_computing_projects" title="List of volunteer computing projects">List of volunteer computing projects</a> – Comprehensive list of volunteer computing projects</li>

<li><a href="Model_checking" title="Model checking">Model checking</a> – Computer science field</li>

<li><a href="OpenHarmony" title="OpenHarmony">OpenHarmony</a> – Family of open-source operating systems based on HarmonyOS</li>

<li><a href="HarmonyOS" title="HarmonyOS">HarmonyOS</a> – Distributed operating system by Huawei</li>

<li><a href="Parallel_distributed_processing" class="mw-redirect" title="Parallel distributed processing">Parallel distributed processing</a> – Cognitive science approachPages displaying short descriptions of redirect targets</li>

<li><a href="Parallel_programming_model" title="Parallel programming model">Parallel programming model</a> – Abstraction of parallel computer architecture</li>

<li><a href="Plan_9_from_Bell_Labs" title="Plan 9 from Bell Labs">Plan 9 from Bell Labs</a> – Research distributed operating system</li>

<li><a href="Shared_nothing_architecture" class="mw-redirect" title="Shared nothing architecture">Shared nothing architecture</a> – Type of distributed computing architecturePages displaying short descriptions of redirect targets</li>

<li><a href="Web_GIS" title="Web GIS">Web GIS</a> – Technologies employing the World Wide Web to manage spatial data</li></ul>

</div>

<div class="mw-heading mw-heading2"><h2 id="Notes">Notes</h2></div>

/* start https://en.wikipedia.org/ */

.mw-parser-output .reflist{margin-bottom:0.5em;list-style-type:decimal}@media screen{.mw-parser-output .reflist{font-size:90%}}.mw-parser-output .reflist .references{font-size:100%;margin-bottom:0;list-style-type:inherit}.mw-parser-output .reflist-columns-2{column-width:30em}.mw-parser-output .reflist-columns-3{column-width:25em}.mw-parser-output .reflist-columns{margin-top:0.3em}.mw-parser-output .reflist-columns ol{margin-top:0}.mw-parser-output .reflist-columns li{page-break-inside:avoid;break-inside:avoid-column}.mw-parser-output .reflist-upper-alpha{list-style-type:upper-alpha}.mw-parser-output .reflist-upper-roman{list-style-type:upper-roman}.mw-parser-output .reflist-lower-alpha{list-style-type:lower-alpha}.mw-parser-output .reflist-lower-greek{list-style-type:lower-greek}.mw-parser-output .reflist-lower-roman{list-style-type:lower-roman}

/* end https://en.wikipedia.org/ */

</style><div class="reflist reflist-columns references-column-width" style="column-width: 30em;">

/* start https://en.wikipedia.org/ */

.mw-parser-output cite.citation{font-style:inherit;word-wrap:break-word}.mw-parser-output .citation q{quotes:"\"""\"""'""'"}.mw-parser-output .citation:target{background-color:rgba(0,127,255,0.133)}.mw-parser-output .id-lock-free.id-lock-free a{background:url("./mw/Lock-green.svg")right 0.1em center/9px no-repeat}.mw-parser-output .id-lock-limited.id-lock-limited a,.mw-parser-output .id-lock-registration.id-lock-registration a{background:url("./mw/Lock-gray-alt-2.svg")right 0.1em center/9px no-repeat}.mw-parser-output .id-lock-subscription.id-lock-subscription a{background:url("./mw/Lock-red-alt-2.svg")right 0.1em center/9px no-repeat}.mw-parser-output .cs1-ws-icon a{background:url("./mw/Wikisource-logo.svg")right 0.1em center/12px no-repeat}body:not(.skin-timeless):not(.skin-minerva) .mw-parser-output .id-lock-free a,body:not(.skin-timeless):not(.skin-minerva) .mw-parser-output .id-lock-limited a,body:not(.skin-timeless):not(.skin-minerva) .mw-parser-output .id-lock-registration a,body:not(.skin-timeless):not(.skin-minerva) .mw-parser-output .id-lock-subscription a,body:not(.skin-timeless):not(.skin-minerva) .mw-parser-output .cs1-ws-icon a{background-size:contain;padding:0 1em 0 0}.mw-parser-output .cs1-code{color:inherit;background:inherit;border:none;padding:inherit}.mw-parser-output .cs1-hidden-error{display:none;color:var(--color-error,#d33)}.mw-parser-output .cs1-visible-error{color:var(--color-error,#d33)}.mw-parser-output .cs1-maint{display:none;color:#085;margin-left:0.3em}.mw-parser-output .cs1-kern-left{padding-left:0.2em}.mw-parser-output .cs1-kern-right{padding-right:0.2em}.mw-parser-output .citation .mw-selflink{font-weight:inherit}@media screen{.mw-parser-output .cs1-format{font-size:95%}html.skin-theme-clientpref-night .mw-parser-output .cs1-maint{color:#18911f}}@media screen and (prefers-color-scheme:dark){html.skin-theme-clientpref-os .mw-parser-output .cs1-maint{color:#18911f}}

/* end https://en.wikipedia.org/ */

</style><cite id="CITEREFTanenbaum,_Andrew_S.Steen,_Maarten_van2002" class="citation book cs1">Tanenbaum, Andrew S.; Steen, Maarten van (2002). <a rel="nofollow" class="external text" href="https://www.distributed-systems.net/index.php/books/ds3/">Distributed systems: principles and paradigms</a>. Upper Saddle River, NJ: Pearson Prentice Hall. <a href="ISBN_(identifier)" class="mw-redirect" title="ISBN (identifier)">ISBN</a> <bdi>0-13-088893-1</bdi>. <a rel="nofollow" class="external text" href="https://web.archive.org/web/20200812174339/https://www.distributed-systems.net/index.php/books/ds3/">Archived</a> from the original on 2020-08-12. Retrieved 2020-08-28.</cite>

</li>

<li id="cite_note-Distributed_Programs_2010_pp._373–406-2"><a href="#cite_ref-Distributed_Programs_2010_pp._373–406_2-0">^</a> <cite class="citation book cs1">"Distributed Programs". Texts in Computer Science. London: Springer London. 2010. pp. 373–406. <a href="Doi_(identifier)" class="mw-redirect" title="Doi (identifier)">doi</a>:<a rel="nofollow" class="external text" href="https://doi.org/10.1007%2F978-1-84882-745-5_11">10.1007/978-1-84882-745-5_11</a>. <a href="ISBN_(identifier)" class="mw-redirect" title="ISBN (identifier)">ISBN</a> <bdi>978-1-84882-744-8</bdi>. <a href="ISSN_(identifier)" class="mw-redirect" title="ISSN (identifier)">ISSN</a> <a rel="nofollow" class="external text" href="https://search.worldcat.org/issn/1868-0941">1868-0941</a>. <q>Systems consist of a number of physically distributed components that work independently using their private storage, but also communicate from time to time by explicit message passing. Such systems are called distributed systems.</q></cite>

</li>

<li id="cite_note-FOOTNOTEDusseauDusseau20161–2-3"><a href="#cite_ref-FOOTNOTEDusseauDusseau20161–2_3-0">^</a> <a href="#CITEREFDusseauDusseau2016">Dusseau & Dusseau 2016</a>, p. 1–2.

</li>

<li id="cite_note-4"><a href="#cite_ref-4">^</a> <cite id="CITEREFFord2020" class="citation book cs1">Ford, Neal (March 3, 2020). Fundamentals of Software Architecture: An Engineering Approach (1st ed.). O'Reilly Media. pp. 146–147. <a href="ISBN_(identifier)" class="mw-redirect" title="ISBN (identifier)">ISBN</a> <bdi>978-1492043454</bdi>.</cite>

</li>

<li id="cite_note-5"><a href="#cite_ref-5">^</a> <cite class="citation book cs1">Monolith to Microservices Evolutionary Patterns to Transform Your Monolith. O'Reilly Media. <a href="ISBN_(identifier)" class="mw-redirect" title="ISBN (identifier)">ISBN</a> <bdi>9781492047810</bdi>.</cite>

</li>

<li id="cite_note-6"><a href="#cite_ref-6">^</a> <cite class="citation book cs1">Building Serverless Applications on Knative. O'Reilly Media. <a href="ISBN_(identifier)" class="mw-redirect" title="ISBN (identifier)">ISBN</a> <bdi>9781098142049</bdi>.</cite>

</li>

<li id="cite_note-Distributed_Programs_2010_pp._373–406_II-7"><a href="#cite_ref-Distributed_Programs_2010_pp._373–406_II_7-0">^</a> <cite class="citation book cs1">"Distributed Programs". Texts in Computer Science. London: Springer London. 2010. pp. 373–406. <a href="Doi_(identifier)" class="mw-redirect" title="Doi (identifier)">doi</a>:<a rel="nofollow" class="external text" href="https://doi.org/10.1007%2F978-1-84882-745-5_11">10.1007/978-1-84882-745-5_11</a>. <a href="ISBN_(identifier)" class="mw-redirect" title="ISBN (identifier)">ISBN</a> <bdi>978-1-84882-744-8</bdi>. <a href="ISSN_(identifier)" class="mw-redirect" title="ISSN (identifier)">ISSN</a> <a rel="nofollow" class="external text" href="https://search.worldcat.org/issn/1868-0941">1868-0941</a>. <q>Distributed programs are abstract descriptions of distributed systems. A distributed program consists of a collection of processes that work concurrently and communicate by explicit message passing. Each process can access a set of variables which are disjoint from the variables that can be changed by any other process.</q></cite>

</li>

<li id="cite_note-8"><a href="#cite_ref-8">^</a> <a href="#CITEREFAndrews2000">Andrews (2000)</a>. <a href="#CITEREFDolev2000">Dolev (2000)</a>. <a href="#CITEREFGhosh2007">Ghosh (2007)</a>, p. 10.

</li>

<li id="cite_note-9"><a href="#cite_ref-9">^</a> <cite id="CITEREFMagnoni2015" class="citation journal cs1">Magnoni, L. (2015). <a rel="nofollow" class="external text" href="https://doi.org/10.1088%2F1742-6596%2F608%2F1%2F012038">"Modern Messaging for Distributed Sytems (sic)"</a>. Journal of Physics: Conference Series. 608 (1): 012038. <a href="Bibcode_(identifier)" class="mw-redirect" title="Bibcode (identifier)">Bibcode</a>:<a rel="nofollow" class="external text" href="https://ui.adsabs.harvard.edu/abs/2015JPhCS.608a2038M">2015JPhCS.608a2038M</a>. <a href="Doi_(identifier)" class="mw-redirect" title="Doi (identifier)">doi</a>:<a rel="nofollow" class="external text" href="https://doi.org/10.1088%2F1742-6596%2F608%2F1%2F012038">10.1088/1742-6596/608/1/012038</a>. <a href="ISSN_(identifier)" class="mw-redirect" title="ISSN (identifier)">ISSN</a> <a rel="nofollow" class="external text" href="https://search.worldcat.org/issn/1742-6596">1742-6596</a>.</cite>

</li>

<li id="cite_note-10"><a href="#cite_ref-10">^</a> <a href="#CITEREFGodfrey2002">Godfrey (2002)</a>.

</li>

<li id="cite_note-Andrews_2000-11">^ <a href="#cite_ref-Andrews_2000_11-0">a</a> <a href="#cite_ref-Andrews_2000_11-1">b</a> <a href="#CITEREFAndrews2000">Andrews (2000)</a>, p. 291–292. <a href="#CITEREFDolev2000">Dolev (2000)</a>, p. 5.

</li>

<li id="cite_note-12"><a href="#cite_ref-12">^</a> <a href="#CITEREFLynch1996">Lynch (1996)</a>, p. 1.

</li>

</li>

<li id="cite_note-14"><a href="#cite_ref-14">^</a> <a href="#CITEREFAndrews2000">Andrews (2000)</a>, pp. 8–9, 291. <a href="#CITEREFDolev2000">Dolev (2000)</a>, p. 5. <a href="#CITEREFGhosh2007">Ghosh (2007)</a>, p. 3. <a href="#CITEREFLynch1996">Lynch (1996)</a>, p. xix, 1. <a href="#CITEREFPeleg2000">Peleg (2000)</a>, p. xv.

</li>

<li id="cite_note-15"><a href="#cite_ref-15">^</a> <a href="#CITEREFAndrews2000">Andrews (2000)</a>, p. 291. <a href="#CITEREFGhosh2007">Ghosh (2007)</a>, p. 3. <a href="#CITEREFPeleg2000">Peleg (2000)</a>, p. 4.

</li>

<li id="cite_note-16"><a href="#cite_ref-16">^</a> <a href="#CITEREFGhosh2007">Ghosh (2007)</a>, p. 3–4. <a href="#CITEREFPeleg2000">Peleg (2000)</a>, p. 1.

</li>

<li id="cite_note-17"><a href="#cite_ref-17">^</a> <a href="#CITEREFGhosh2007">Ghosh (2007)</a>, p. 4. <a href="#CITEREFPeleg2000">Peleg (2000)</a>, p. 2.

</li>

<li id="cite_note-18"><a href="#cite_ref-18">^</a> <a href="#CITEREFGhosh2007">Ghosh (2007)</a>, p. 4, 8. <a href="#CITEREFLynch1996">Lynch (1996)</a>, p. 2–3. <a href="#CITEREFPeleg2000">Peleg (2000)</a>, p. 4.

</li>

<li id="cite_note-19"><a href="#cite_ref-19">^</a> <a href="#CITEREFLynch1996">Lynch (1996)</a>, p. 2. <a href="#CITEREFPeleg2000">Peleg (2000)</a>, p. 1.

</li>

<li id="cite_note-20"><a href="#cite_ref-20">^</a> <a href="#CITEREFGhosh2007">Ghosh (2007)</a>, p. 7. <a href="#CITEREFLynch1996">Lynch (1996)</a>, p. xix, 2. <a href="#CITEREFPeleg2000">Peleg (2000)</a>, p. 4.

</li>

<li id="cite_note-21"><a href="#cite_ref-21">^</a> <cite class="citation book cs1">Fundamentals of Software Architecture: An Engineering Approach. O'Reilly Media. 2020. <a href="ISBN_(identifier)" class="mw-redirect" title="ISBN (identifier)">ISBN</a> <bdi>978-1492043454</bdi>.</cite>

</li>

<li id="cite_note-:1-22">^ <a href="#cite_ref-:1_22-0">a</a> <a href="#cite_ref-:1_22-1">b</a> <a href="#cite_ref-:1_22-2">c</a> <a href="#cite_ref-:1_22-3">d</a> <cite id="CITEREFKleppmann2017" class="citation book cs1">Kleppmann, Martin (2017). Designing Data-Intensive Applications: The Big Ideas Behind Reliable, Scalable, and Maintainable Systems. O'Reilly Media. <a href="ISBN_(identifier)" class="mw-redirect" title="ISBN (identifier)">ISBN</a> <bdi>978-1449373320</bdi>.</cite>

</li>

<li id="cite_note-:2-23">^ <a href="#cite_ref-:2_23-0">a</a> <a href="#cite_ref-:2_23-1">b</a> <a href="#cite_ref-:2_23-2">c</a> <a href="#cite_ref-:2_23-3">d</a> <cite class="citation book cs1">Building Event-Driven Microservices: Leveraging Organizational Data at Scale. <a href="ISBN_(identifier)" class="mw-redirect" title="ISBN (identifier)">ISBN</a> <bdi>978-1492057895</bdi>.</cite>

</li>

<li id="cite_note-24"><a href="#cite_ref-24">^</a> <a href="#CITEREFGhosh2007">Ghosh (2007)</a>, p. 10. <a href="#CITEREFKeidar2008">Keidar (2008)</a>.

</li>

<li id="cite_note-25"><a href="#cite_ref-25">^</a> <a href="#CITEREFLynch1996">Lynch (1996)</a>, p. xix, 1–2. <a href="#CITEREFPeleg2000">Peleg (2000)</a>, p. 1.

</li>

<li id="cite_note-26"><a href="#cite_ref-26">^</a> <a href="#CITEREFPeleg2000">Peleg (2000)</a>, p. 1.

</li>

<li id="cite_note-27"><a href="#cite_ref-27">^</a> <a href="#CITEREFPapadimitriou1994">Papadimitriou (1994)</a>, Chapter 15. <a href="#CITEREFKeidar2008">Keidar (2008)</a>.

</li>

<li id="cite_note-28"><a href="#cite_ref-28">^</a> See references in <a href="#Introduction">Introduction</a>.

</li>

<li id="cite_note-BetalebParallel16-29"><a href="#cite_ref-BetalebParallel16_29-0">^</a> <cite id="CITEREFBentaleb,_A.Yifan,_L.Xin,_J.2016" class="citation web cs1">Bentaleb, A.; Yifan, L.; Xin, J.; et al. (2016). <a rel="nofollow" class="external text" href="http://www.comp.nus.edu.sg/~rahul/allfiles/cs6234-16-pds.pdf">"Parallel and Distributed Algorithms"</a> (PDF). National University of Singapore. <a rel="nofollow" class="external text" href="https://web.archive.org/web/20170326210614/http://www.comp.nus.edu.sg/~rahul/allfiles/cs6234-16-pds.pdf">Archived</a> (PDF) from the original on 2017-03-26. Retrieved 20 July 2018.</cite>

</li>

<li id="cite_note-30"><a href="#cite_ref-30">^</a> <a href="#CITEREFAndrews2000">Andrews (2000)</a>, p. 348.

</li>

<li id="cite_note-31"><a href="#cite_ref-31">^</a> <a href="#CITEREFAndrews2000">Andrews (2000)</a>, p. 32.

</li>

<li id="cite_note-32"><a href="#cite_ref-32">^</a> <a href="#CITEREFPeter2004">Peter (2004)</a>, <a rel="nofollow" class="external text" href="http://www.nethistory.info/History%20of%20the%20Internet/email.html">The history of email</a> <a rel="nofollow" class="external text" href="https://web.archive.org/web/20090415220152/http://www.nethistory.info/History%20of%20the%20Internet/email.html">Archived</a> 2009-04-15 at the <a href="Wayback_Machine" title="Wayback Machine">Wayback Machine</a>.

</li>

<li id="cite_note-BanksOnThe12-33"><a href="#cite_ref-BanksOnThe12_33-0">^</a> <cite id="CITEREFBanks,_M.2012" class="citation book cs1">Banks, M. (2012). <a rel="nofollow" class="external text" href="https://books.google.com/books?id=1J78hiHKaPoC&pg=PT67">On the Way to the Web: The Secret History of the Internet and its Founders</a>. Apress. pp. 44–5. <a href="ISBN_(identifier)" class="mw-redirect" title="ISBN (identifier)">ISBN</a> <bdi>9781430250746</bdi>. <a rel="nofollow" class="external text" href="https://web.archive.org/web/20230120182450/https://books.google.com/books?id=1J78hiHKaPoC&pg=PT67">Archived</a> from the original on 2023-01-20. Retrieved 2018-07-20.</cite>

</li>

<li id="cite_note-TelIntro00-34"><a href="#cite_ref-TelIntro00_34-0">^</a> <cite id="CITEREFTel,_G.2000" class="citation book cs1">Tel, G. (2000). <a rel="nofollow" class="external text" href="https://books.google.com/books?id=vlpnS25qAJQC&pg=PA35">Introduction to Distributed Algorithms</a>. Cambridge University Press. pp. 35–36. <a href="ISBN_(identifier)" class="mw-redirect" title="ISBN (identifier)">ISBN</a> <bdi>9780521794831</bdi>. <a rel="nofollow" class="external text" href="https://web.archive.org/web/20230120182450/https://books.google.com/books?id=vlpnS25qAJQC&pg=PA35">Archived</a> from the original on 2023-01-20. Retrieved 2018-07-20.</cite>

</li>

<li id="cite_note-OhlídalEvo06-35"><a href="#cite_ref-OhlídalEvo06_35-0">^</a> <cite id="CITEREFOhlídal,_M.Jaroš,_J.Schwarz,_J.2006" class="citation book cs1">Ohlídal, M.; Jaroš, J.; Schwarz, J.; et al. (2006). "Evolutionary Design of OAB and AAB Communication Schedules for Interconnection Networks". In Rothlauf, F.; Branke, J.; Cagnoni, S. (eds.). Applications of Evolutionary Computing. Springer Science & Business Media. pp. 267–78. <a href="ISBN_(identifier)" class="mw-redirect" title="ISBN (identifier)">ISBN</a> <bdi>9783540332374</bdi>.</cite>

</li>

<li id="cite_note-36"><a href="#cite_ref-36">^</a> <cite class="citation journal cs1"><a rel="nofollow" class="external text" href="https://web.archive.org/web/20170110015222/https://pdfs.semanticscholar.org/2950/37ee46ac281590f67435380cebc385ac9749.pdf">"Real Time And Distributed Computing Systems"</a> (PDF). <a href="ISSN_(identifier)" class="mw-redirect" title="ISSN (identifier)">ISSN</a> <a rel="nofollow" class="external text" href="https://search.worldcat.org/issn/2278-0661">2278-0661</a>. Archived from <a rel="nofollow" class="external text" href="https://pdfs.semanticscholar.org/2950/37ee46ac281590f67435380cebc385ac9749.pdf">the original</a> (PDF) on 2017-01-10. Retrieved 2017-01-09.</cite> <code class="cs1-code">{{cite journal}}</code>: Cite journal requires <code class="cs1-code">|journal=</code> (help)

</li>

<li id="cite_note-Vigna20150127-37"><a href="#cite_ref-Vigna20150127_37-0">^</a> Vigna P, Casey MJ. The Age of Cryptocurrency: How Bitcoin and the Blockchain Are Challenging the Global Economic Order St. Martin's Press January 27, 2015 <a href="ISBN_(identifier)" class="mw-redirect" title="ISBN (identifier)">ISBN</a> <bdi>9781250065636</bdi>

</li>

<li id="cite_note-38"><a href="#cite_ref-38">^</a> <cite id="CITEREFQuang_Hieu_VuMihai_LupuBeng_Chin_Ooi2010" class="citation book cs1">Quang Hieu Vu; Mihai Lupu; Beng Chin Ooi (2010). Peer-to-peer computing : principles and applications. Heidelberg: Springer. p. 16. <a href="ISBN_(identifier)" class="mw-redirect" title="ISBN (identifier)">ISBN</a> <bdi>9783642035135</bdi>. <a href="OCLC_(identifier)" class="mw-redirect" title="OCLC (identifier)">OCLC</a> <a rel="nofollow" class="external text" href="https://search.worldcat.org/oclc/663093862">663093862</a>.</cite>

</li>

<li id="cite_note-39"><a href="#cite_ref-39">^</a> <cite id="CITEREFLindAlm2006" class="citation cs2">Lind P, Alm M (2006), "A database-centric virtual chemistry system", J Chem Inf Model, 46 (3): 1034–9, <a href="Doi_(identifier)" class="mw-redirect" title="Doi (identifier)">doi</a>:<a rel="nofollow" class="external text" href="https://doi.org/10.1021%2Fci050360b">10.1021/ci050360b</a>, <a href="PMID_(identifier)" class="mw-redirect" title="PMID (identifier)">PMID</a> <a rel="nofollow" class="external text" href="https://pubmed.ncbi.nlm.nih.gov/16711722">16711722</a>.</cite>

</li>

<li id="cite_note-40"><a href="#cite_ref-40">^</a> <cite id="CITEREFChiu1990" class="citation journal cs1">Chiu, G (1990). "A model for optimal database allocation in distributed computing systems". Proceedings. IEEE INFOCOM'90: Ninth Annual Joint Conference of the IEEE Computer and Communications Societies.</cite>

</li>

<li id="cite_note-:22-41"><a href="#cite_ref-:22_41-0">^</a> <cite id="CITEREFNewman2015" class="citation book cs1">Newman, Sam (2015-02-20). Building Microservices. O'Reilly Media. <a href="ISBN_(identifier)" class="mw-redirect" title="ISBN (identifier)">ISBN</a> <bdi>978-1491950357</bdi>.</cite>

</li>

<li id="cite_note-:3-42"><a href="#cite_ref-:3_42-0">^</a> <cite id="CITEREFRichardson2019" class="citation book cs1">Richardson, Chris (2019). Microservices patterns: with examples in Java. Shelter Island, NY: Manning Publications. <a href="ISBN_(identifier)" class="mw-redirect" title="ISBN (identifier)">ISBN</a> <bdi>978-1-61729-454-9</bdi>.</cite>

</li>

<li id="cite_note-:4-43"><a href="#cite_ref-:4_43-0">^</a> <cite id="CITEREFChristudas2019" class="citation book cs1">Christudas, Binildas (2019). Practical Microservices Architectural Patterns: Event-Based Java Microservices with Spring Boot and Spring Cloud. Berkeley, CA: Apress L. P. <a href="ISBN_(identifier)" class="mw-redirect" title="ISBN (identifier)">ISBN</a> <bdi>978-1-4842-4501-9</bdi>.</cite>

</li>

<li id="cite_note-:23-44"><a href="#cite_ref-:23_44-0">^</a> <cite id="CITEREFNewman2015" class="citation book cs1">Newman, Sam (2015-02-20). Building Microservices. O'Reilly Media. <a href="ISBN_(identifier)" class="mw-redirect" title="ISBN (identifier)">ISBN</a> <bdi>978-1491950357</bdi>.</cite>

</li>

<li id="cite_note-:32-45"><a href="#cite_ref-:32_45-0">^</a> <cite id="CITEREFRichardson2019" class="citation book cs1">Richardson, Chris (2019). Microservices patterns: with examples in Java. Shelter Island, NY: Manning Publications. <a href="ISBN_(identifier)" class="mw-redirect" title="ISBN (identifier)">ISBN</a> <bdi>978-1-61729-454-9</bdi>.</cite>

</li>

<li id="cite_note-:42-46"><a href="#cite_ref-:42_46-0">^</a> <cite id="CITEREFChristudas2019" class="citation book cs1">Christudas, Binildas (2019). Practical Microservices Architectural Patterns: Event-Based Java Microservices with Spring Boot and Spring Cloud. Berkeley, CA: Apress L. P. <a href="ISBN_(identifier)" class="mw-redirect" title="ISBN (identifier)">ISBN</a> <bdi>978-1-4842-4501-9</bdi>.</cite>

</li>

<li id="cite_note-:24-47"><a href="#cite_ref-:24_47-0">^</a> <cite id="CITEREFNewman2015" class="citation book cs1">Newman, Sam (2015-02-20). Building Microservices. O'Reilly Media. <a href="ISBN_(identifier)" class="mw-redirect" title="ISBN (identifier)">ISBN</a> <bdi>978-1491950357</bdi>.</cite>

</li>

<li id="cite_note-:33-48"><a href="#cite_ref-:33_48-0">^</a> <cite id="CITEREFRichardson2019" class="citation book cs1">Richardson, Chris (2019). Microservices patterns: with examples in Java. Shelter Island, NY: Manning Publications. <a href="ISBN_(identifier)" class="mw-redirect" title="ISBN (identifier)">ISBN</a> <bdi>978-1-61729-454-9</bdi>.</cite>

</li>

<li id="cite_note-:43-49"><a href="#cite_ref-:43_49-0">^</a> <cite id="CITEREFChristudas2019" class="citation book cs1">Christudas, Binildas (2019). Practical Microservices Architectural Patterns: Event-Based Java Microservices with Spring Boot and Spring Cloud. Berkeley, CA: Apress L. P. <a href="ISBN_(identifier)" class="mw-redirect" title="ISBN (identifier)">ISBN</a> <bdi>978-1-4842-4501-9</bdi>.</cite>

</li>

<li id="cite_note-:25-50"><a href="#cite_ref-:25_50-0">^</a> <cite id="CITEREFNewman2015" class="citation book cs1">Newman, Sam (2015-02-20). Building Microservices. O'Reilly Media. <a href="ISBN_(identifier)" class="mw-redirect" title="ISBN (identifier)">ISBN</a> <bdi>978-1491950357</bdi>.</cite>

</li>

<li id="cite_note-:34-51"><a href="#cite_ref-:34_51-0">^</a> <cite id="CITEREFRichardson2019" class="citation book cs1">Richardson, Chris (2019). Microservices patterns: with examples in Java. Shelter Island, NY: Manning Publications. <a href="ISBN_(identifier)" class="mw-redirect" title="ISBN (identifier)">ISBN</a> <bdi>978-1-61729-454-9</bdi>.</cite>

</li>

<li id="cite_note-:44-52"><a href="#cite_ref-:44_52-0">^</a> <cite id="CITEREFChristudas2019" class="citation book cs1">Christudas, Binildas (2019). Practical Microservices Architectural Patterns: Event-Based Java Microservices with Spring Boot and Spring Cloud. Berkeley, CA: Apress L. P. <a href="ISBN_(identifier)" class="mw-redirect" title="ISBN (identifier)">ISBN</a> <bdi>978-1-4842-4501-9</bdi>.</cite>

</li>

<li id="cite_note-53"><a href="#cite_ref-53">^</a> <a href="#CITEREFElmasriNavathe2000">Elmasri & Navathe (2000)</a>, Section 24.1.2.

</li>

<li id="cite_note-54"><a href="#cite_ref-54">^</a> <a href="#CITEREFAndrews2000">Andrews (2000)</a>, p. 10–11. <a href="#CITEREFGhosh2007">Ghosh (2007)</a>, p. 4–6. <a href="#CITEREFLynch1996">Lynch (1996)</a>, p. xix, 1. <a href="#CITEREFPeleg2000">Peleg (2000)</a>, p. xv. <a href="#CITEREFElmasriNavathe2000">Elmasri & Navathe (2000)</a>, Section 24.

</li>

<li id="cite_note-55"><a href="#cite_ref-55">^</a> <cite id="CITEREFHaussmann2019" class="citation journal cs1">Haussmann, J. (2019). "Cost-efficient parallel processing of irregularly structured problems in cloud computing environments". Journal of Cluster Computing. 22 (3): 887–909. <a href="Doi_(identifier)" class="mw-redirect" title="Doi (identifier)">doi</a>:<a rel="nofollow" class="external text" href="https://doi.org/10.1007%2Fs10586-018-2879-3">10.1007/s10586-018-2879-3</a>. <a href="S2CID_(identifier)" class="mw-redirect" title="S2CID (identifier)">S2CID</a> <a rel="nofollow" class="external text" href="https://api.semanticscholar.org/CorpusID:54447518">54447518</a>.</cite>

</li>

<li id="cite_note-56"><a href="#cite_ref-56">^</a> <cite class="citation book cs1">Reactive Application Development. Manning. 2018. <a href="ISBN_(identifier)" class="mw-redirect" title="ISBN (identifier)">ISBN</a> <bdi>9781638355816</bdi>.</cite>

</li>

<li id="cite_note-ToomarianNeural92-57"><a href="#cite_ref-ToomarianNeural92_57-0">^</a> <cite id="CITEREFToomarian,_N.B.Barhen,_J.Gulati,_S.1992" class="citation book cs1">Toomarian, N.B.; Barhen, J.; Gulati, S. (1992). <a rel="nofollow" class="external text" href="https://books.google.com/books?id=CKTsCgAAQBAJ&pg=PA214">"Neural Networks for Real-Time Robotic Applications"</a>. In Fijany, A.; Bejczy, A. (eds.). Parallel Computation Systems For Robotics: Algorithms And Architectures. World Scientific. p. 214. <a href="ISBN_(identifier)" class="mw-redirect" title="ISBN (identifier)">ISBN</a> <bdi>9789814506175</bdi>. <a rel="nofollow" class="external text" href="https://web.archive.org/web/20200801024715/https://books.google.com/books?id=CKTsCgAAQBAJ&pg=PA214">Archived</a> from the original on 2020-08-01. Retrieved 2018-07-20.</cite>

</li>

<li id="cite_note-SavageModels98-58"><a href="#cite_ref-SavageModels98_58-0">^</a> <cite id="CITEREFSavage,_J.E.1998" class="citation book cs1">Savage, J.E. (1998). Models of Computation: Exploring the Power of Computing. Addison Wesley. p. 209. <a href="ISBN_(identifier)" class="mw-redirect" title="ISBN (identifier)">ISBN</a> <bdi>9780201895391</bdi>.</cite>

</li>

<li id="cite_note-59"><a href="#cite_ref-59">^</a> <a href="#CITEREFCormenLeisersonRivest1990">Cormen, Leiserson & Rivest (1990)</a>, Section 30.

</li>

<li id="cite_note-60"><a href="#cite_ref-60">^</a> <a href="#CITEREFHerlihyShavit2008">Herlihy & Shavit (2008)</a>, Chapters 2–6.

</li>

<li id="cite_note-61"><a href="#cite_ref-61">^</a> <a href="#CITEREFLynch1996">Lynch (1996)</a>

</li>

<li id="cite_note-62"><a href="#cite_ref-62">^</a> <a href="#CITEREFCormenLeisersonRivest1990">Cormen, Leiserson & Rivest (1990)</a>, Sections 28 and 29.

</li>

<li id="cite_note-:0-63">^ <a href="#cite_ref-:0_63-0">a</a> <a href="#cite_ref-:0_63-1">b</a> <a href="#cite_ref-:0_63-2">c</a> TULSIRAMJI GAIKWAD-PATIL College of Engineering & Technology,

Nagpur

Department of Information Technology

Introduction to Distributed Systems<a rel="nofollow" class="external autonumber" href="http://www.tgpcet.com/assets/img/IT/Notes/8/Distributed-System.pdf">[1]</a>

</li>

<li id="cite_note-64"><a href="#cite_ref-64">^</a> <a href="#CITEREFColeVishkin1986">Cole & Vishkin (1986)</a>. <a href="#CITEREFCormenLeisersonRivest1990">Cormen, Leiserson & Rivest (1990)</a>, Section 30.5.

</li>

<li id="cite_note-65"><a href="#cite_ref-65">^</a> <a href="#CITEREFAndrews2000">Andrews (2000)</a>, p. ix.

</li>

<li id="cite_note-66"><a href="#cite_ref-66">^</a> <a href="#CITEREFAroraBarak2009">Arora & Barak (2009)</a>, Section 6.7. <a href="#CITEREFPapadimitriou1994">Papadimitriou (1994)</a>, Section 15.3.

</li>

<li id="cite_note-67"><a href="#cite_ref-67">^</a> <a href="#CITEREFPapadimitriou1994">Papadimitriou (1994)</a>, Section 15.2.

</li>

<li id="cite_note-68"><a href="#cite_ref-68">^</a> <a href="#CITEREFLynch1996">Lynch (1996)</a>, p. 17–23.

</li>

<li id="cite_note-69"><a href="#cite_ref-69">^</a> <a href="#CITEREFPeleg2000">Peleg (2000)</a>, Sections 2.3 and 7. <a href="#CITEREFLinial1992">Linial (1992)</a>. <a href="#CITEREFNaorStockmeyer1995">Naor & Stockmeyer (1995)</a>.

</li>

<li id="cite_note-SchneiderTrading11-70"><a href="#cite_ref-SchneiderTrading11_70-0">^</a> <cite id="CITEREFSchneider,_J.Wattenhofer,_R.2011" class="citation book cs1">Schneider, J.; Wattenhofer, R. (2011). <a rel="nofollow" class="external text" href="https://books.google.com/books?id=dT6nwpXvES4C&pg=PA51">"Trading Bit, Message, and Time Complexity of Distributed Algorithms"</a>. In Peleg, D. (ed.). Distributed Computing. Springer Science & Business Media. pp. 51–65. <a href="ISBN_(identifier)" class="mw-redirect" title="ISBN (identifier)">ISBN</a> <bdi>9783642240997</bdi>. <a rel="nofollow" class="external text" href="https://web.archive.org/web/20200801023020/https://books.google.com/books?id=dT6nwpXvES4C&pg=PA51">Archived</a> from the original on 2020-08-01. Retrieved 2018-07-20.</cite>

</li>

<li id="cite_note-71"><a href="#cite_ref-71">^</a> <a href="#CITEREFLynch1996">Lynch (1996)</a>, Sections 5–7. <a href="#CITEREFGhosh2007">Ghosh (2007)</a>, Chapter 13.

</li>

<li id="cite_note-72"><a href="#cite_ref-72">^</a> <a href="#CITEREFLynch1996">Lynch (1996)</a>, p. 99–102. <a href="#CITEREFGhosh2007">Ghosh (2007)</a>, p. 192–193.

</li>

<li id="cite_note-73"><a href="#cite_ref-73">^</a> <a href="#CITEREFDolev2000">Dolev (2000)</a>. <a href="#CITEREFGhosh2007">Ghosh (2007)</a>, Chapter 17.

</li>

<li id="cite_note-74"><a href="#cite_ref-74">^</a> <a href="#CITEREFLynch1996">Lynch (1996)</a>, Section 16. <a href="#CITEREFPeleg2000">Peleg (2000)</a>, Section 6.

</li>

<li id="cite_note-75"><a href="#cite_ref-75">^</a> <a href="#CITEREFLynch1996">Lynch (1996)</a>, Section 18. <a href="#CITEREFGhosh2007">Ghosh (2007)</a>, Sections 6.2–6.3.

</li>

<li id="cite_note-76"><a href="#cite_ref-76">^</a> <a href="#CITEREFGhosh2007">Ghosh (2007)</a>, Section 6.4.

</li>

<li id="cite_note-77"><a href="#cite_ref-77">^</a> <cite id="CITEREFKamburugamuveEkanayake2021" class="citation book cs1">Kamburugamuve, Supun; Ekanayake, Saliya (2021). Foundations of Data Intensive Applications Large Scale Data Analytics Under the Hood. John Wiley & Sons. <a href="ISBN_(identifier)" class="mw-redirect" title="ISBN (identifier)">ISBN</a> <bdi>9781119713012</bdi>.</cite>

</li>

<li id="cite_note-HaloiApache15-78">^ <a href="#cite_ref-HaloiApache15_78-0">a</a> <a href="#cite_ref-HaloiApache15_78-1">b</a> <cite id="CITEREFHaloi,_S.2015" class="citation book cs1">Haloi, S. (2015). <a rel="nofollow" class="external text" href="https://books.google.com/books?id=Ym9uBgAAQBAJ&pg=PA100">Apache ZooKeeper Essentials</a>. Packt Publishing Ltd. pp. 100–101. <a href="ISBN_(identifier)" class="mw-redirect" title="ISBN (identifier)">ISBN</a> <bdi>9781784398323</bdi>. <a rel="nofollow" class="external text" href="https://web.archive.org/web/20230120182456/https://books.google.com/books?id=Ym9uBgAAQBAJ&pg=PA100">Archived</a> from the original on 2023-01-20. Retrieved 2018-07-20.</cite>

</li>

<li id="cite_note-79"><a href="#cite_ref-79">^</a> <cite id="CITEREFLeLann1977" class="citation journal cs1">LeLann, G. (1977). "Distributed systems - toward a formal approach". Information Processing. 77: 155·160 – via Elsevier.</cite>

</li>

<li id="cite_note-80"><a href="#cite_ref-80">^</a> <cite id="CITEREFR._G._Gallager,_P._A._Humblet,_and_P._M._Spira1983" class="citation journal cs1"><a href="Robert_G._Gallager" title="Robert G. Gallager">R. G. Gallager</a>, P. A. Humblet, and P. M. Spira (January 1983). <a rel="nofollow" class="external text" href="http://www.apposite-tech.com/blog/wp-content/uploads/2017/09/p66-gallager.pdf">"A Distributed Algorithm for Minimum-Weight Spanning Trees"</a> (PDF). ACM Transactions on Programming Languages and Systems. 5 (1): 66–77. <a href="Doi_(identifier)" class="mw-redirect" title="Doi (identifier)">doi</a>:<a rel="nofollow" class="external text" href="https://doi.org/10.1145%2F357195.357200">10.1145/357195.357200</a>. <a href="S2CID_(identifier)" class="mw-redirect" title="S2CID (identifier)">S2CID</a> <a rel="nofollow" class="external text" href="https://api.semanticscholar.org/CorpusID:2758285">2758285</a>. <a rel="nofollow" class="external text" href="https://web.archive.org/web/20170926040957/http://www.apposite-tech.com/blog/wp-content/uploads/2017/09/p66-gallager.pdf">Archived</a> (PDF) from the original on 2017-09-26.</cite><code class="cs1-code">{{cite journal}}</code>: CS1 maint: multiple names: authors list (link)

</li>

<li id="cite_note-81"><a href="#cite_ref-81">^</a> <cite id="CITEREFKorachKuttenMoran1990" class="citation journal cs1">Korach, Ephraim; <a href="Shay_Kutten" title="Shay Kutten">Kutten, Shay</a>; <a href="Shlomo_Moran" title="Shlomo Moran">Moran, Shlomo</a> (1990). <a rel="nofollow" class="external text" href="https://www.cs.technion.ac.il/~moran/r/PS/kkm.pdf">"A Modular Technique for the Design of Efficient Distributed Leader Finding Algorithms"</a> (PDF). ACM Transactions on Programming Languages and Systems. 12 (1): 84–101. <a href="CiteSeerX_(identifier)" class="mw-redirect" title="CiteSeerX (identifier)">CiteSeerX</a> <a rel="nofollow" class="external text" href="https://citeseerx.ist.psu.edu/viewdoc/summary?doi=10.1.1.139.7342">10.1.1.139.7342</a>. <a href="Doi_(identifier)" class="mw-redirect" title="Doi (identifier)">doi</a>:<a rel="nofollow" class="external text" href="https://doi.org/10.1145%2F77606.77610">10.1145/77606.77610</a>. <a href="S2CID_(identifier)" class="mw-redirect" title="S2CID (identifier)">S2CID</a> <a rel="nofollow" class="external text" href="https://api.semanticscholar.org/CorpusID:9175968">9175968</a>. <a rel="nofollow" class="external text" href="https://web.archive.org/web/20070418150944/http://www.cs.technion.ac.il/~moran/r/PS/kkm.pdf">Archived</a> (PDF) from the original on 2007-04-18.</cite>

</li>

<li id="cite_note-82"><a href="#cite_ref-82">^</a> <cite id="CITEREFHamilton" class="citation web cs1">Hamilton, Howard. <a rel="nofollow" class="external text" href="http://www2.cs.uregina.ca/~hamilton/courses/330/notes/distributed/distributed.html">"Distributed Algorithms"</a>. <a rel="nofollow" class="external text" href="https://web.archive.org/web/20121124002402/http://www2.cs.uregina.ca/~hamilton/courses/330/notes/distributed/distributed.html">Archived</a> from the original on 2012-11-24. Retrieved 2013-03-03.</cite>

</li>

<li id="cite_note-83"><a href="#cite_ref-83">^</a> <cite class="citation web cs1"><a rel="nofollow" class="external text" href="https://cstheory.stackexchange.com/q/10045">"Major unsolved problems in distributed systems?"</a>. cstheory.stackexchange.com. <a rel="nofollow" class="external text" href="https://web.archive.org/web/20230120182442/https://cstheory.stackexchange.com/questions/10045/major-unsolved-problems-in-distributed-systems">Archived</a> from the original on 20 January 2023. Retrieved 16 March 2018.</cite>

</li>

<li id="cite_note-84"><a href="#cite_ref-84">^</a> <cite class="citation web cs1"><a rel="nofollow" class="external text" href="http://www.theserverside.com/feature/How-big-data-and-distributed-systems-solve-traditional-scalability-problems">"How big data and distributed systems solve traditional scalability problems"</a>. theserverside.com. <a rel="nofollow" class="external text" href="https://web.archive.org/web/20180317232027/http://www.theserverside.com/feature/How-big-data-and-distributed-systems-solve-traditional-scalability-problems">Archived</a> from the original on 17 March 2018. Retrieved 16 March 2018.</cite>

</li>

<li id="cite_note-SvozilIndet11-85"><a href="#cite_ref-SvozilIndet11_85-0">^</a> <cite id="CITEREFSvozil,_K.2011" class="citation book cs1">Svozil, K. (2011). <a rel="nofollow" class="external text" href="https://books.google.com/books?id=ep_FCgAAQBAJ&pg=PA112">"Indeterminism and Randomness Through Physics"</a>. In Hector, Z. (ed.). Randomness Through Computation: Some Answers, More Questions. World Scientific. pp. 112–3. <a href="ISBN_(identifier)" class="mw-redirect" title="ISBN (identifier)">ISBN</a> <bdi>9789814462631</bdi>. <a rel="nofollow" class="external text" href="https://web.archive.org/web/20200801024745/https://books.google.com/books?id=ep_FCgAAQBAJ&pg=PA112">Archived</a> from the original on 2020-08-01. Retrieved 2018-07-20.</cite>

</li>

<li id="cite_note-86"><a href="#cite_ref-86">^</a> <a href="#CITEREFPapadimitriou1994">Papadimitriou (1994)</a>, Section 19.3.

</li>

</ol></div>

<div class="mw-heading mw-heading2"><h2 id="References">References</h2></div>

/* start https://en.wikipedia.org/ */

.mw-parser-output .refbegin{margin-bottom:0.5em}.mw-parser-output .refbegin-hanging-indents>ul{margin-left:0}.mw-parser-output .refbegin-hanging-indents>ul>li{margin-left:0;padding-left:3.2em;text-indent:-3.2em}.mw-parser-output .refbegin-hanging-indents ul,.mw-parser-output .refbegin-hanging-indents ul li{list-style:none}@media(max-width:720px){.mw-parser-output .refbegin-hanging-indents>ul>li{padding-left:1.6em;text-indent:-1.6em}}.mw-parser-output .refbegin-columns{margin-top:0.3em}.mw-parser-output .refbegin-columns ul{margin-top:0}.mw-parser-output .refbegin-columns li{page-break-inside:avoid;break-inside:avoid-column}@media screen{.mw-parser-output .refbegin{font-size:90%}}

/* end https://en.wikipedia.org/ */

</style><div class="refbegin refbegin-columns references-column-width" style="column-width: 30em">

<dl><dt>Books</dt></dl>

<ul><li><cite id="CITEREFAndrews2000" class="citation cs2">Andrews, Gregory R. (2000), <a rel="nofollow" class="external text" href="https://archive.org/details/foundationsofmul0000andr">Foundations of Multithreaded, Parallel, and Distributed Programming</a>, <a href="Addison%E2%80%93Wesley" class="mw-redirect" title="Addison–Wesley">Addison–Wesley</a>, <a href="ISBN_(identifier)" class="mw-redirect" title="ISBN (identifier)">ISBN</a> <bdi>978-0-201-35752-3</bdi></cite>.</li>

<li><cite id="CITEREFAroraBarak2009" class="citation cs2"><a href="Sanjeev_Arora" title="Sanjeev Arora">Arora, Sanjeev</a>; Barak, Boaz (2009), Computational Complexity – A Modern Approach, <a href="Cambridge_University_Press" title="Cambridge University Press">Cambridge</a>, <a href="ISBN_(identifier)" class="mw-redirect" title="ISBN (identifier)">ISBN</a> <bdi>978-0-521-42426-4</bdi></cite>.</li>

<li><cite id="CITEREFCormenLeisersonRivest1990" class="citation cs2"><a href="Thomas_H._Cormen" title="Thomas H. Cormen">Cormen, Thomas H.</a>; <a href="Charles_E._Leiserson" title="Charles E. Leiserson">Leiserson, Charles E.</a>; <a href="Ron_Rivest" title="Ron Rivest">Rivest, Ronald L.</a> (1990), <a href="Introduction_to_Algorithms" title="Introduction to Algorithms">Introduction to Algorithms</a> (1st ed.), <a href="MIT_Press" title="MIT Press">MIT Press</a>, <a href="Bibcode_(identifier)" class="mw-redirect" title="Bibcode (identifier)">Bibcode</a>:<a rel="nofollow" class="external text" href="https://ui.adsabs.harvard.edu/abs/1990ita..book.....C">1990ita..book.....C</a>, <a href="ISBN_(identifier)" class="mw-redirect" title="ISBN (identifier)">ISBN</a> <bdi>978-0-262-03141-7</bdi></cite>.</li>

<li><cite id="CITEREFDolev2000" class="citation cs2"><a href="Shlomi_Dolev" title="Shlomi Dolev">Dolev, Shlomi</a> (2000), Self-Stabilization, <a href="MIT_Press" title="MIT Press">MIT Press</a>, <a href="ISBN_(identifier)" class="mw-redirect" title="ISBN (identifier)">ISBN</a> <bdi>978-0-262-04178-2</bdi></cite>.</li>

<li><cite id="CITEREFElmasriNavathe2000" class="citation cs2">Elmasri, Ramez; <a href="Shamkant_Navathe" title="Shamkant Navathe">Navathe, Shamkant B.</a> (2000), Fundamentals of Database Systems (3rd ed.), <a href="Addison%E2%80%93Wesley" class="mw-redirect" title="Addison–Wesley">Addison–Wesley</a>, <a href="ISBN_(identifier)" class="mw-redirect" title="ISBN (identifier)">ISBN</a> <bdi>978-0-201-54263-9</bdi></cite>.</li>

<li><cite id="CITEREFGhosh2007" class="citation cs2">Ghosh, Sukumar (2007), Distributed Systems – An Algorithmic Approach, Chapman & Hall/CRC, <a href="ISBN_(identifier)" class="mw-redirect" title="ISBN (identifier)">ISBN</a> <bdi>978-1-58488-564-1</bdi></cite>.</li>

<li><cite id="CITEREFLynch1996" class="citation cs2"><a href="Nancy_Lynch" title="Nancy Lynch">Lynch, Nancy A.</a> (1996), <a rel="nofollow" class="external text" href="https://archive.org/details/distributedalgor0000lync">Distributed Algorithms</a>, <a href="Morgan_Kaufmann" class="mw-redirect" title="Morgan Kaufmann">Morgan Kaufmann</a>, <a href="ISBN_(identifier)" class="mw-redirect" title="ISBN (identifier)">ISBN</a> <bdi>978-1-55860-348-6</bdi></cite>.</li>

<li><cite id="CITEREFHerlihyShavit2008" class="citation cs2"><a href="Maurice_Herlihy" title="Maurice Herlihy">Herlihy, Maurice P.</a>; <a href="Nir_Shavit" title="Nir Shavit">Shavit, Nir N.</a> (2008), The Art of Multiprocessor Programming, <a href="Morgan_Kaufmann" class="mw-redirect" title="Morgan Kaufmann">Morgan Kaufmann</a>, <a href="ISBN_(identifier)" class="mw-redirect" title="ISBN (identifier)">ISBN</a> <bdi>978-0-12-370591-4</bdi></cite>.</li>

<li><cite id="CITEREFPapadimitriou1994" class="citation cs2"><a href="Christos_Papadimitriou" title="Christos Papadimitriou">Papadimitriou, Christos H.</a> (1994), Computational Complexity, <a href="Addison%E2%80%93Wesley" class="mw-redirect" title="Addison–Wesley">Addison–Wesley</a>, <a href="ISBN_(identifier)" class="mw-redirect" title="ISBN (identifier)">ISBN</a> <bdi>978-0-201-53082-7</bdi></cite>.</li>

<li><cite id="CITEREFPeleg2000" class="citation cs2"><a href="David_Peleg_(scientist)" class="mw-redirect" title="David Peleg (scientist)">Peleg, David</a> (2000), <a rel="nofollow" class="external text" href="https://web.archive.org/web/20090806070332/http://www.ec-securehost.com/SIAM/DT05.html">Distributed Computing: A Locality-Sensitive Approach</a>, <a href="SIAM" class="mw-redirect" title="SIAM">SIAM</a>, <a href="ISBN_(identifier)" class="mw-redirect" title="ISBN (identifier)">ISBN</a> <bdi>978-0-89871-464-7</bdi>, archived from <a rel="nofollow" class="external text" href="http://www.ec-securehost.com/SIAM/DT05.html">the original</a> on 2009-08-06, retrieved 2009-07-16</cite>.</li></ul>

<dl><dt>Articles</dt></dl>

<ul><li><cite id="CITEREFColeVishkin1986" class="citation cs2">Cole, Richard; <a href="Uzi_Vishkin" title="Uzi Vishkin">Vishkin, Uzi</a> (1986), "Deterministic coin tossing with applications to optimal parallel list ranking", Information and Control, 70 (1): 32–53, <a href="Doi_(identifier)" class="mw-redirect" title="Doi (identifier)">doi</a>:<a rel="nofollow" class="external text" href="https://doi.org/10.1016%2FS0019-9958%2886%2980023-7">10.1016/S0019-9958(86)80023-7</a></cite>.</li>

<li><cite id="CITEREFKeidar2008" class="citation cs2"><a href="Idit_Keidar" title="Idit Keidar">Keidar, Idit</a> (2008), <a rel="nofollow" class="external text" href="https://web.archive.org/web/20140116123634/http://webee.technion.ac.il/~idish/sigactNews/#column%2032">"Distributed computing column 32 – The year in review"</a>, <a href="ACM_SIGACT_News" class="mw-redirect" title="ACM SIGACT News">ACM SIGACT News</a>, 39 (4): 53–54, <a href="CiteSeerX_(identifier)" class="mw-redirect" title="CiteSeerX (identifier)">CiteSeerX</a> <a rel="nofollow" class="external text" href="https://citeseerx.ist.psu.edu/viewdoc/summary?doi=10.1.1.116.1285">10.1.1.116.1285</a>, <a href="Doi_(identifier)" class="mw-redirect" title="Doi (identifier)">doi</a>:<a rel="nofollow" class="external text" href="https://doi.org/10.1145%2F1466390.1466402">10.1145/1466390.1466402</a>, <a href="S2CID_(identifier)" class="mw-redirect" title="S2CID (identifier)">S2CID</a> <a rel="nofollow" class="external text" href="https://api.semanticscholar.org/CorpusID:7607391">7607391</a>, archived from <a rel="nofollow" class="external text" href="http://webee.technion.ac.il/~idish/sigactNews/#column%2032">the original</a> on 2014-01-16, retrieved 2009-08-20</cite>.</li>

<li><cite id="CITEREFLinial1992" class="citation cs2"><a href="Nati_Linial" title="Nati Linial">Linial, Nathan</a> (1992), "Locality in distributed graph algorithms", SIAM Journal on Computing, 21 (1): 193–201, <a href="CiteSeerX_(identifier)" class="mw-redirect" title="CiteSeerX (identifier)">CiteSeerX</a> <a rel="nofollow" class="external text" href="https://citeseerx.ist.psu.edu/viewdoc/summary?doi=10.1.1.471.6378">10.1.1.471.6378</a>, <a href="Doi_(identifier)" class="mw-redirect" title="Doi (identifier)">doi</a>:<a rel="nofollow" class="external text" href="https://doi.org/10.1137%2F0221015">10.1137/0221015</a></cite>.</li>

<li><cite id="CITEREFNaorStockmeyer1995" class="citation cs2"><a href="Moni_Naor" title="Moni Naor">Naor, Moni</a>; <a href="Larry_Stockmeyer" title="Larry Stockmeyer">Stockmeyer, Larry</a> (1995), <a rel="nofollow" class="external text" href="http://www.wisdom.weizmann.ac.il/~naor/PAPERS/lcl.pdf">"What can be computed locally?"</a> (PDF), SIAM Journal on Computing, 24 (6): 1259–1277, <a href="CiteSeerX_(identifier)" class="mw-redirect" title="CiteSeerX (identifier)">CiteSeerX</a> <a rel="nofollow" class="external text" href="https://citeseerx.ist.psu.edu/viewdoc/summary?doi=10.1.1.29.669">10.1.1.29.669</a>, <a href="Doi_(identifier)" class="mw-redirect" title="Doi (identifier)">doi</a>:<a rel="nofollow" class="external text" href="https://doi.org/10.1137%2FS0097539793254571">10.1137/S0097539793254571</a>, <a rel="nofollow" class="external text" href="https://web.archive.org/web/20130108030723/http://www.wisdom.weizmann.ac.il/~naor/PAPERS/lcl.pdf">archived</a> (PDF) from the original on 2013-01-08</cite>.</li></ul>

<dl><dt>Web sites</dt></dl>

<ul><li><cite id="CITEREFGodfrey2002" class="citation web cs1">Godfrey, Bill (2002). <a rel="nofollow" class="external text" href="https://billpg.com/bacchae-co-uk/docs/dist.html">"A primer on distributed computing"</a>. <a rel="nofollow" class="external text" href="https://web.archive.org/web/20210513163858/https://billpg.com/bacchae-co-uk/docs/dist.html">Archived</a> from the original on 2021-05-13. Retrieved 2021-05-13.</cite></li>

<li><cite id="CITEREFPeter2004" class="citation web cs1">Peter, Ian (2004). <a rel="nofollow" class="external text" href="http://www.nethistory.info/History%20of%20the%20Internet/">"Ian Peter's History of the Internet"</a>. <a rel="nofollow" class="external text" href="https://web.archive.org/web/20100120220410/http://www.nethistory.info/History%20of%20the%20Internet/">Archived</a> from the original on 2010-01-20. Retrieved 2009-08-04.</cite></li></ul>

</div>

<div class="mw-heading mw-heading2"><h2 id="Further_reading">Further reading</h2></div>

<dl><dt>Books</dt></dl>

<ul><li><cite id="CITEREFAttiya,_Hagit_and_Jennifer_Welch2004" class="citation cs2"><a href="Hagit_Attiya" title="Hagit Attiya">Attiya, Hagit</a> and Jennifer Welch (2004), Distributed Computing: Fundamentals, Simulations, and Advanced Topics, Wiley-Interscience</cite> <a href="ISBN_(identifier)" class="mw-redirect" title="ISBN (identifier)">ISBN</a> <bdi>0-471-45324-2</bdi>.</li>

<li><cite id="CITEREFChristian_CachinRachid_GuerraouiLuís_Rodrigues2011" class="citation cs2">Christian Cachin; Rachid Guerraoui; Luís Rodrigues (2011), Introduction to Reliable and Secure Distributed Programming (2. ed.), Springer, <a href="Bibcode_(identifier)" class="mw-redirect" title="Bibcode (identifier)">Bibcode</a>:<a rel="nofollow" class="external text" href="https://ui.adsabs.harvard.edu/abs/2011itra.book.....C">2011itra.book.....C</a>, <a href="ISBN_(identifier)" class="mw-redirect" title="ISBN (identifier)">ISBN</a> <bdi>978-3-642-15259-7</bdi></cite></li>

<li><cite id="CITEREFCoulouris,_George2011" class="citation cs2">Coulouris, George; et al. (2011), Distributed Systems: Concepts and Design (5th Edition), Addison-Wesley</cite> <a href="ISBN_(identifier)" class="mw-redirect" title="ISBN (identifier)">ISBN</a> <bdi>0-132-14301-1</bdi>.</li>

<li><cite id="CITEREFFaber1998" class="citation cs2">Faber, Jim (1998), <a rel="nofollow" class="external text" href="http://docstore.mik.ua/orelly/java-ent/dist/index.htm">Java Distributed Computing</a>, O'Reilly, <a rel="nofollow" class="external text" href="https://web.archive.org/web/20100824170917/http://docstore.mik.ua/orelly/java-ent/dist/index.htm">archived</a> from the original on 2010-08-24, retrieved 2010-09-29</cite>: <a rel="nofollow" class="external text" href="http://docstore.mik.ua/orelly/java-ent/dist/index.htm">Java Distributed Computing by Jim Faber, 1998</a> <a rel="nofollow" class="external text" href="https://web.archive.org/web/20100824170917/http://docstore.mik.ua/orelly/java-ent/dist/index.htm">Archived</a> 2010-08-24 at the <a href="Wayback_Machine" title="Wayback Machine">Wayback Machine</a></li>

<li><cite id="CITEREFGarg,_Vijay_K.2002" class="citation cs2">Garg, Vijay K. (2002), Elements of Distributed Computing, Wiley-IEEE Press</cite> <a href="ISBN_(identifier)" class="mw-redirect" title="ISBN (identifier)">ISBN</a> <bdi>0-471-03600-5</bdi>.</li>

<li><cite id="CITEREFTel1994" class="citation cs2">Tel, Gerard (1994), Introduction to Distributed Algorithms, Cambridge University Press</cite></li>

<li><cite id="CITEREFChandy,_Mani1988" class="citation cs2"><a href="K._Mani_Chandy" title="K. Mani Chandy">Chandy, Mani</a>; et al. (1988), Parallel Program Design, Addison-Wesley</cite> <a href="ISBN_(identifier)" class="mw-redirect" title="ISBN (identifier)">ISBN</a> <bdi>0201058669</bdi></li>

<li><cite id="CITEREFDusseauDusseau2016" class="citation book cs1">Dusseau, Remzi H.; Dusseau, Andrea (2016). <a rel="nofollow" class="external text" href="https://web.archive.org/web/20210831013525/https://pages.cs.wisc.edu/~remzi/OSTEP/dist-intro.pdf">Operating Systems: Three Easy Pieces, Chapter 48 Distributed Systems</a> (PDF). Archived from <a rel="nofollow" class="external text" href="https://pages.cs.wisc.edu/~remzi/OSTEP/dist-intro.pdf">the original</a> (PDF) on 31 August 2021. Retrieved 8 October 2021.</cite></li></ul>

<dl><dt>Articles</dt></dl>

<ul><li><cite id="CITEREFKeidarRajsbaum2000–2009" class="citation cs2">Keidar, Idit; Rajsbaum, Sergio, eds. (2000–2009), <a rel="nofollow" class="external text" href="https://web.archive.org/web/20140116123634/http://webee.technion.ac.il/~idish/sigactNews/">"Distributed computing column"</a>, <a href="ACM_SIGACT_News" class="mw-redirect" title="ACM SIGACT News">ACM SIGACT News</a>, archived from <a rel="nofollow" class="external text" href="http://webee.technion.ac.il/~idish/sigactNews/">the original</a> on 2014-01-16, retrieved 2009-08-16</cite>.</li>

<li><cite id="CITEREFBirrellLevinSchroederNeedham1982" class="citation journal cs1">Birrell, A. D.; Levin, R.; Schroeder, M. D.; <a href="Roger_M._Needham" class="mw-redirect" title="Roger M. Needham">Needham, R. M.</a> (April 1982). <a rel="nofollow" class="external text" href="http://web.cs.wpi.edu/~cs4513/d07/Papers/Birrell,%20Levin,%20et.%20al.,%20Grapevine.pdf">"Grapevine: An exercise in distributed computing"</a> (PDF). <a href="Communications_of_the_ACM" title="Communications of the ACM">Communications of the ACM</a>. 25 (4): 260–274. <a href="Doi_(identifier)" class="mw-redirect" title="Doi (identifier)">doi</a>:<a rel="nofollow" class="external text" href="https://doi.org/10.1145%2F358468.358487">10.1145/358468.358487</a>. <a href="S2CID_(identifier)" class="mw-redirect" title="S2CID (identifier)">S2CID</a> <a rel="nofollow" class="external text" href="https://api.semanticscholar.org/CorpusID:16066616">16066616</a>. <a rel="nofollow" class="external text" href="https://web.archive.org/web/20160730064812/http://web.cs.wpi.edu/~cs4513/d07/Papers/Birrell,%20Levin,%20et.%20al.,%20Grapevine.pdf">Archived</a> (PDF) from the original on 2016-07-30.</cite></li></ul>

<dl><dt>Conference Papers</dt></dl>

<ul><li><cite id="CITEREFRodriguezVillagraBaran2007" class="citation book cs1">Rodriguez, Carlos; Villagra, Marcos; Baran, Benjamin (2007). "Asynchronous team algorithms for Boolean Satisfiability". 2007 2nd Bio-Inspired Models of Network, Information and Computing Systems. pp. 66–69. <a href="Doi_(identifier)" class="mw-redirect" title="Doi (identifier)">doi</a>:<a rel="nofollow" class="external text" href="https://doi.org/10.1109%2FBIMNICS.2007.4610083">10.1109/BIMNICS.2007.4610083</a>. <a href="S2CID_(identifier)" class="mw-redirect" title="S2CID (identifier)">S2CID</a> <a rel="nofollow" class="external text" href="https://api.semanticscholar.org/CorpusID:15185219">15185219</a>.</cite></li></ul>

</div>

<div class="mw-heading mw-heading2"><h2 id="External_links">External links</h2></div>

/* start https://en.wikipedia.org/ */

.mw-parser-output .side-box{margin:4px 0;box-sizing:border-box;border:1px solid #aaa;font-size:88%;line-height:1.25em;background-color:var(--background-color-interactive-subtle,#f8f9fa);display:flow-root}.mw-parser-output .infobox .side-box{font-size:100%}.mw-parser-output .side-box-abovebelow,.mw-parser-output .side-box-text{padding:0.25em 0.9em}.mw-parser-output .side-box-image{padding:2px 0 2px 0.9em;text-align:center}.mw-parser-output .side-box-imageright{padding:2px 0.9em 2px 0;text-align:center}@media(min-width:500px){.mw-parser-output .side-box-flex{display:flex;align-items:center}.mw-parser-output .side-box-text{flex:1;min-width:0}}@media(min-width:720px){.mw-parser-output .side-box{width:238px}.mw-parser-output .side-box-right{clear:right;float:right;margin-left:1em}.mw-parser-output .side-box-left{margin-right:1em}}

/* end https://en.wikipedia.org/ */

</style><style data-mw-deduplicate="TemplateStyles:r1237033735">

/* start https://en.wikipedia.org/ */

@media print{body.ns-0 .mw-parser-output .sistersitebox{display:none!important}}@media screen{html.skin-theme-clientpref-night .mw-parser-output .sistersitebox img[src*="Wiktionary-logo-en-v2.svg"]{background-color:white}}@media screen and (prefers-color-scheme:dark){html.skin-theme-clientpref-os .mw-parser-output .sistersitebox img[src*="Wiktionary-logo-en-v2.svg"]{background-color:white}}

/* end https://en.wikipedia.org/ */

</style><div class="side-box side-box-right sistersitebox"><style data-mw-deduplicate="TemplateStyles:r1126788409">

/* start https://en.wikipedia.org/ */

.mw-parser-output .plainlist ol,.mw-parser-output .plainlist ul{line-height:inherit;list-style:none;margin:0;padding:0}.mw-parser-output .plainlist ol li,.mw-parser-output .plainlist ul li{margin-bottom:0}

/* end https://en.wikipedia.org/ */

</style>

<div class="side-box-text plainlist">Wikiquote has quotations related to <a href="https://en.wikiquote.org/wiki/Special:Search/Distributed_computing" class="extiw external" title="q:Special:Search/Distributed computing">Distributed computing</a>.</div></div>

</div>

<ul><li> Media related to <a href="https://commons.wikimedia.org/wiki/Category:Distributed_computing" class="extiw external" title="commons:Category:Distributed computing">Distributed computing</a> at Wikimedia Commons</li></ul>

/* start https://en.wikipedia.org/ */

.mw-parser-output .hlist dl,.mw-parser-output .hlist ol,.mw-parser-output .hlist ul{margin:0;padding:0}.mw-parser-output .hlist dd,.mw-parser-output .hlist dt,.mw-parser-output .hlist li{margin:0;display:inline}.mw-parser-output .hlist.inline,.mw-parser-output .hlist.inline dl,.mw-parser-output .hlist.inline ol,.mw-parser-output .hlist.inline ul,.mw-parser-output .hlist dl dl,.mw-parser-output .hlist dl ol,.mw-parser-output .hlist dl ul,.mw-parser-output .hlist ol dl,.mw-parser-output .hlist ol ol,.mw-parser-output .hlist ol ul,.mw-parser-output .hlist ul dl,.mw-parser-output .hlist ul ol,.mw-parser-output .hlist ul ul{display:inline}.mw-parser-output .hlist .mw-empty-li{display:none}.mw-parser-output .hlist dt::after{content:": "}.mw-parser-output .hlist dd::after,.mw-parser-output .hlist li::after{content:" · ";font-weight:bold}.mw-parser-output .hlist dd:last-child::after,.mw-parser-output .hlist dt:last-child::after,.mw-parser-output .hlist li:last-child::after{content:none}.mw-parser-output .hlist dd dd:first-child::before,.mw-parser-output .hlist dd dt:first-child::before,.mw-parser-output .hlist dd li:first-child::before,.mw-parser-output .hlist dt dd:first-child::before,.mw-parser-output .hlist dt dt:first-child::before,.mw-parser-output .hlist dt li:first-child::before,.mw-parser-output .hlist li dd:first-child::before,.mw-parser-output .hlist li dt:first-child::before,.mw-parser-output .hlist li li:first-child::before{content:" (";font-weight:normal}.mw-parser-output .hlist dd dd:last-child::after,.mw-parser-output .hlist dd dt:last-child::after,.mw-parser-output .hlist dd li:last-child::after,.mw-parser-output .hlist dt dd:last-child::after,.mw-parser-output .hlist dt dt:last-child::after,.mw-parser-output .hlist dt li:last-child::after,.mw-parser-output .hlist li dd:last-child::after,.mw-parser-output .hlist li dt:last-child::after,.mw-parser-output .hlist li li:last-child::after{content:")";font-weight:normal}.mw-parser-output .hlist ol{counter-reset:listitem}.mw-parser-output .hlist ol>li{counter-increment:listitem}.mw-parser-output .hlist ol>li::before{content:" "counter(listitem)"\a0 "}.mw-parser-output .hlist dd ol>li:first-child::before,.mw-parser-output .hlist dt ol>li:first-child::before,.mw-parser-output .hlist li ol>li:first-child::before{content:" ("counter(listitem)"\a0 "}

/* end https://en.wikipedia.org/ */

</style><style data-mw-deduplicate="TemplateStyles:r1236075235">

/* start https://en.wikipedia.org/ */

.mw-parser-output .navbox{box-sizing:border-box;border:1px solid #a2a9b1;width:100%;clear:both;font-size:88%;text-align:center;padding:1px;margin:1em auto 0}.mw-parser-output .navbox .navbox{margin-top:0}.mw-parser-output .navbox+.navbox,.mw-parser-output .navbox+.navbox-styles+.navbox{margin-top:-1px}.mw-parser-output .navbox-inner,.mw-parser-output .navbox-subgroup{width:100%}.mw-parser-output .navbox-group,.mw-parser-output .navbox-title,.mw-parser-output .navbox-abovebelow{padding:0.25em 1em;line-height:1.5em;text-align:center}.mw-parser-output .navbox-group{white-space:nowrap;text-align:right}.mw-parser-output .navbox,.mw-parser-output .navbox-subgroup{background-color:#fdfdfd}.mw-parser-output .navbox-list{line-height:1.5em;border-color:#fdfdfd}.mw-parser-output .navbox-list-with-group{text-align:left;border-left-width:2px;border-left-style:solid}.mw-parser-output tr+tr>.navbox-abovebelow,.mw-parser-output tr+tr>.navbox-group,.mw-parser-output tr+tr>.navbox-image,.mw-parser-output tr+tr>.navbox-list{border-top:2px solid #fdfdfd}.mw-parser-output .navbox-title{background-color:#ccf}.mw-parser-output .navbox-abovebelow,.mw-parser-output .navbox-group,.mw-parser-output .navbox-subgroup .navbox-title{background-color:#ddf}.mw-parser-output .navbox-subgroup .navbox-group,.mw-parser-output .navbox-subgroup .navbox-abovebelow{background-color:#e6e6ff}.mw-parser-output .navbox-even{background-color:#f7f7f7}.mw-parser-output .navbox-odd{background-color:transparent}.mw-parser-output .navbox .hlist td dl,.mw-parser-output .navbox .hlist td ol,.mw-parser-output .navbox .hlist td ul,.mw-parser-output .navbox td.hlist dl,.mw-parser-output .navbox td.hlist ol,.mw-parser-output .navbox td.hlist ul{padding:0.125em 0}.mw-parser-output .navbox .navbar{display:block;font-size:100%}.mw-parser-output .navbox-title .navbar{float:left;text-align:left;margin-right:0.5em}body.skin--responsive .mw-parser-output .navbox-image img{max-width:none!important}@media print{body.ns-0 .mw-parser-output .navbox{display:none!important}}

/* end https://en.wikipedia.org/ */

</style></div><div role="navigation" class="navbox" aria-labelledby="Parallel_computing346" style="padding:3px"><table class="nowraplinks hlist mw-collapsible autocollapse navbox-inner" style="border-spacing:0;background:transparent;color:inherit"><tbody><tr><th scope="col" class="navbox-title" colspan="2"><style data-mw-deduplicate="TemplateStyles:r1239400231">

/* start https://en.wikipedia.org/ */

.mw-parser-output .navbar{display:inline;font-size:88%;font-weight:normal}.mw-parser-output .navbar-collapse{float:left;text-align:left}.mw-parser-output .navbar-boxtext{word-spacing:0}.mw-parser-output .navbar ul{display:inline-block;white-space:nowrap;line-height:inherit}.mw-parser-output .navbar-brackets::before{margin-right:-0.125em;content:"[ "}.mw-parser-output .navbar-brackets::after{margin-left:-0.125em;content:" ]"}.mw-parser-output .navbar li{word-spacing:-0.125em}.mw-parser-output .navbar a>span,.mw-parser-output .navbar a>abbr{text-decoration:inherit}.mw-parser-output .navbar-mini abbr{font-variant:small-caps;border-bottom:none;text-decoration:none;cursor:inherit}.mw-parser-output .navbar-ct-full{font-size:114%;margin:0 7em}.mw-parser-output .navbar-ct-mini{font-size:114%;margin:0 4em}html.skin-theme-clientpref-night .mw-parser-output .navbar li a abbr{color:var(--color-base)!important}@media(prefers-color-scheme:dark){html.skin-theme-clientpref-os .mw-parser-output .navbar li a abbr{color:var(--color-base)!important}}@media print{.mw-parser-output .navbar{display:none!important}}

/* end https://en.wikipedia.org/ */

</style><div id="Parallel_computing346" style="font-size:114%;margin:0 4em"><a href="Parallel_computing" title="Parallel computing">Parallel computing</a></div></th></tr><tr><th scope="row" class="navbox-group" style="width:1%">General</th><td class="navbox-list-with-group navbox-list navbox-odd" style="width:100%;padding:0"><div style="padding:0 0.25em">

<ul>

<li><a href="Parallel_computing" title="Parallel computing">Parallel computing</a></li>

<li><a href="Parallel_algorithm" title="Parallel algorithm">Parallel algorithm</a></li>

<li><a href="Massively_parallel" title="Massively parallel">Massively parallel</a></li>

<li><a href="Cloud_computing" title="Cloud computing">Cloud computing</a></li>

<li><a href="High-performance_computing" title="High-performance computing">High-performance computing</a></li>

<li><a href="Multiprocessing" title="Multiprocessing">Multiprocessing</a></li>

<li><a href="Manycore_processor" title="Manycore processor">Manycore processor</a></li>

<li>GPGPU software</li>

<li><a href="Computer_network" title="Computer network">Computer network</a></li>

<li><a href="Systolic_array" title="Systolic array">Systolic array</a></li></ul>

</div></td></tr><tr><th scope="row" class="navbox-group" style="width:1%">Levels</th><td class="navbox-list-with-group navbox-list navbox-even" style="width:100%;padding:0"><div style="padding:0 0.25em">

<li><a href="Instruction-level_parallelism" title="Instruction-level parallelism">Instruction</a></li>

<li><a href="Task_parallelism" title="Task parallelism">Thread</a></li>

<li><a href="Memory-level_parallelism" title="Memory-level parallelism">Memory</a></li>

<li><a href="Pipeline_(computing)" title="Pipeline (computing)">Pipeline</a></li></ul>

</div></td></tr><tr><th scope="row" class="navbox-group" style="width:1%"><a href="Multithreading_(computer_architecture)" title="Multithreading (computer architecture)">Multithreading</a></th><td class="navbox-list-with-group navbox-list navbox-odd" style="width:100%;padding:0"><div style="padding:0 0.25em">

<ul><li><a href="Temporal_multithreading" title="Temporal multithreading">Temporal</a></li>

<li><a href="Simultaneous_multithreading" title="Simultaneous multithreading">Simultaneous</a> (SMT)</li>

<li><a href="Simultaneous_and_heterogeneous_multithreading" title="Simultaneous and heterogeneous multithreading">Simultaneous and heterogenous</a></li>

<li><a href="Speculative_multithreading" title="Speculative multithreading">Speculative</a> (SpMT)</li>

<li><a href="Preemption_(computing)" title="Preemption (computing)">Preemptive</a></li>

<li><a href="Computer_multitasking#Cooperative_multitasking" title="Computer multitasking">Cooperative</a></li>

<li><a href="Bulldozer_(microarchitecture)#Bulldozer_core" title="Bulldozer (microarchitecture)">Clustered multi-thread</a> (CMT)</li>

<li><a href="Hardware_scout" title="Hardware scout">Hardware scout</a></li></ul>

</div></td></tr><tr><th scope="row" class="navbox-group" style="width:1%">Theory</th><td class="navbox-list-with-group navbox-list navbox-even" style="width:100%;padding:0"><div style="padding:0 0.25em">

<ul><li><a href="Parallel_RAM" title="Parallel RAM">PRAM model</a></li>

<li><a href="Parallel_external_memory" title="Parallel external memory">PEM model</a></li>

<li><a href="Analysis_of_parallel_algorithms" title="Analysis of parallel algorithms">Analysis of parallel algorithms</a></li>

<li><a href="Amdahl's_law" title="Amdahl's law">Amdahl's law</a></li>

<li><a href="Gustafson's_law" title="Gustafson's law">Gustafson's law</a></li>

<li><a href="Cost_efficiency" title="Cost efficiency">Cost efficiency</a></li>

<li><a href="Karp%E2%80%93Flatt_metric" title="Karp–Flatt metric">Karp–Flatt metric</a></li>

<li><a href="Parallel_slowdown" title="Parallel slowdown">Slowdown</a></li>

<li><a href="Speedup" title="Speedup">Speedup</a></li></ul>

</div></td></tr><tr><th scope="row" class="navbox-group" style="width:1%">Elements</th><td class="navbox-list-with-group navbox-list navbox-odd" style="width:100%;padding:0"><div style="padding:0 0.25em">

<ul><li><a href="Process_(computing)" title="Process (computing)">Process</a></li>

<li><a href="Thread_(computing)" title="Thread (computing)">Thread</a></li>

<li><a href="Fiber_(computer_science)" title="Fiber (computer science)">Fiber</a></li>

<li><a href="Instruction_window" title="Instruction window">Instruction window</a></li>

<li><a href="Array_(data_structure)" title="Array (data structure)">Array</a></li></ul>

</div></td></tr><tr><th scope="row" class="navbox-group" style="width:1%">Coordination</th><td class="navbox-list-with-group navbox-list navbox-even" style="width:100%;padding:0"><div style="padding:0 0.25em">

<ul><li><a href="Multiprocessing" title="Multiprocessing">Multiprocessing</a></li>

<li><a href="Memory_coherence" title="Memory coherence">Memory coherence</a></li>

<li><a href="Cache_coherence" title="Cache coherence">Cache coherence</a></li>

<li><a href="Cache_invalidation" title="Cache invalidation">Cache invalidation</a></li>

<li><a href="Barrier_(computer_science)" title="Barrier (computer science)">Barrier</a></li>

<li><a href="Synchronization_(computer_science)" title="Synchronization (computer science)">Synchronization</a></li>

<li><a href="Application_checkpointing" title="Application checkpointing">Application checkpointing</a></li></ul>

</div></td></tr><tr><th scope="row" class="navbox-group" style="width:1%"><a href="Computer_programming" title="Computer programming">Programming</a></th><td class="navbox-list-with-group navbox-list navbox-odd" style="width:100%;padding:0"><div style="padding:0 0.25em">

<ul><li><a href="Stream_processing" title="Stream processing">Stream processing</a></li>

<li><a href="Dataflow_programming" title="Dataflow programming">Dataflow programming</a></li>

<li><a href="Parallel_programming_model" title="Parallel programming model">Models</a>

<ul><li><a href="Implicit_parallelism" title="Implicit parallelism">Implicit parallelism</a></li>

<li><a href="Explicit_parallelism" title="Explicit parallelism">Explicit parallelism</a></li>

<li><a href="Concurrency_(computer_science)" title="Concurrency (computer science)">Concurrency</a></li></ul></li>

<li><a href="Non-blocking_algorithm" title="Non-blocking algorithm">Non-blocking algorithm</a></li></ul>

</div></td></tr><tr><th scope="row" class="navbox-group" style="width:1%"><a href="Computer_hardware" title="Computer hardware">Hardware</a></th><td class="navbox-list-with-group navbox-list navbox-even" style="width:100%;padding:0"><div style="padding:0 0.25em">

<ul><li><a href="Flynn's_taxonomy" title="Flynn's taxonomy">Flynn's taxonomy</a>

<ul><li><a href="Single_instruction%2C_multiple_threads" title="Single instruction, multiple threads">Array processing</a> (SIMT)</li>

<li><a href="Flynn's_taxonomy#Pipelined_processor" title="Flynn's taxonomy">Pipelined processing</a></li>

<li><a href="Flynn's_taxonomy#Associative_processor" title="Flynn's taxonomy">Associative processing</a></li></ul></li>

<li><a href="Dataflow_architecture" title="Dataflow architecture">Dataflow architecture</a></li>

<li>GPGPU hardware</li>

<li><a href="Instruction_pipelining" title="Instruction pipelining">Pipelined processor</a></li>

<li><a href="Superscalar_processor" title="Superscalar processor">Superscalar processor</a></li>

<li><a href="Vector_processor" title="Vector processor">Vector processor</a></li>

<li><a href="Multiprocessing" title="Multiprocessing">Multiprocessor</a>

<ul><li><a href="Symmetric_multiprocessing" title="Symmetric multiprocessing">symmetric</a></li>

<li><a href="Asymmetric_multiprocessing" title="Asymmetric multiprocessing">asymmetric</a></li></ul></li>

<li><a href="Semiconductor_memory" title="Semiconductor memory">Memory</a>

<ul><li><a href="Shared_memory" title="Shared memory">shared</a></li>

<li><a href="Distributed_memory" title="Distributed memory">distributed</a></li>

<li><a href="Distributed_shared_memory" title="Distributed shared memory">distributed shared</a></li>

<li><a href="Massively_parallel" title="Massively parallel">Massively parallel</a> computer</li>

<li><a href="Computer_cluster" title="Computer cluster">Computer cluster</a>

<ul><li><a href="Beowulf_cluster" title="Beowulf cluster">Beowulf cluster</a></li></ul></li>

<li><a href="Grid_computing" title="Grid computing">Grid computer</a></li>

<li><a href="Hardware_acceleration" title="Hardware acceleration">Hardware acceleration</a></li></ul>

</div></td></tr><tr><th scope="row" class="navbox-group" style="width:1%"><a href="API" title="API">APIs</a></th><td class="navbox-list-with-group navbox-list navbox-odd" style="width:100%;padding:0"><div style="padding:0 0.25em">

<ul><li><a href="Ateji_PX" title="Ateji PX">Ateji PX</a></li>

<li><a href="Boost_(C%2B%2B_libraries)" title="Boost (C++ libraries)">Boost</a></li>

<li><a href="Chapel_(programming_language)" title="Chapel (programming language)">Chapel</a></li>

<li><a href="Charm%2B%2B" title="Charm++">Charm++</a></li>

<li><a href="Coarray_Fortran" title="Coarray Fortran">Coarray Fortran</a></li>

<li><a href="Dryad_(programming)" title="Dryad (programming)">Dryad</a></li>

<li><a href="Global_Arrays" title="Global Arrays">Global Arrays</a></li>

<li><a href="GPUOpen" title="GPUOpen">GPUOpen</a></li>

<li><a href="OpenMP" title="OpenMP">OpenMP</a></li>

<li><a href="OpenCL" title="OpenCL">OpenCL</a></li>

<li><a href="OpenHMPP" title="OpenHMPP">OpenHMPP</a></li>

<li><a href="OpenACC" title="OpenACC">OpenACC</a></li>

<li><a href="Parallel_Extensions" title="Parallel Extensions">Parallel Extensions</a></li>

<li><a href="Pthreads" title="Pthreads">pthreads</a></li>

<li><a href="RaftLib" title="RaftLib">RaftLib</a></li>

</div></td></tr><tr><th scope="row" class="navbox-group" style="width:1%">Problems</th><td class="navbox-list-with-group navbox-list navbox-even" style="width:100%;padding:0"><div style="padding:0 0.25em">

<ul><li><a href="Automatic_parallelization" title="Automatic parallelization">Automatic parallelization</a></li>

<li><a href="Deadlock_(computer_science)" title="Deadlock (computer science)">Deadlock</a></li>

<li><a href="Deterministic_algorithm" title="Deterministic algorithm">Deterministic algorithm</a></li>

<li><a href="Embarrassingly_parallel" title="Embarrassingly parallel">Embarrassingly parallel</a></li>

<li><a href="Parallel_slowdown" title="Parallel slowdown">Parallel slowdown</a></li>

<li><a href="Race_condition" title="Race condition">Race condition</a></li>

<li><a href="Software_lockout" title="Software lockout">Software lockout</a></li>

<li><a href="Scalability" title="Scalability">Scalability</a></li>

<li><a href="Starvation_(computer_science)" title="Starvation (computer science)">Starvation</a></li></ul>

</div></td></tr><tr><td class="navbox-abovebelow" colspan="2"><div>

<ul><li> Category: Parallel computing</li></ul>

</div></td></tr></tbody></table></div>

<div class="navbox-styles"></div><div role="navigation" class="navbox authority-control" aria-labelledby="Authority_control_databases_frameless&#124;text-top&#124;10px&#124;alt=Edit_this_at_Wikidata&#124;link=https&#58;//www.wikidata.org/wiki/Q180634#identifiers&#124;class=noprint&#124;Edit_this_at_Wikidata1277" style="padding:3px"><table class="nowraplinks hlist mw-collapsible autocollapse navbox-inner" style="border-spacing:0;background:transparent;color:inherit"><tbody><tr><th scope="col" class="navbox-title" colspan="2"><div id="Authority_control_databases_frameless&#124;text-top&#124;10px&#124;alt=Edit_this_at_Wikidata&#124;link=https&#58;//www.wikidata.org/wiki/Q180634#identifiers&#124;class=noprint&#124;Edit_this_at_Wikidata1277" style="font-size:114%;margin:0 4em">Authority control databases </div></th></tr><tr><th scope="row" class="navbox-group" style="width:1%">International</th><td class="navbox-list-with-group navbox-list navbox-odd" style="width:100%;padding:0"><div style="padding:0 0.25em"><ul><li><a rel="nofollow" class="external text" href="https://id.worldcat.org/fast/906987">FAST</a></li></ul></div></td></tr><tr><th scope="row" class="navbox-group" style="width:1%">National</th><td class="navbox-list-with-group navbox-list navbox-even" style="width:100%;padding:0"><div style="padding:0 0.25em"><ul><li><a rel="nofollow" class="external text" href="https://d-nb.info/gnd/7545389-7">Germany</a></li><li><a rel="nofollow" class="external text" href="https://id.loc.gov/authorities/sh85042293">United States</a></li><li><a rel="nofollow" class="external text" href="https://catalogue.bnf.fr/ark:/12148/cb11932111w">France</a></li><li><a rel="nofollow" class="external text" href="https://data.bnf.fr/ark:/12148/cb11932111w">BnF data</a></li><li><a rel="nofollow" class="external text" href="https://datos.bne.es/resource/XX545920">Spain</a></li><li><a rel="nofollow" class="external text" href="https://kopkatalogs.lv/F?func=direct&local_base=lnc10&doc_number=000115923&P_CON_LNG=ENG">Latvia</a></li><li><a rel="nofollow" class="external text" href="https://www.nli.org.il/en/authorities/987007538304905171">Israel</a></li></ul></div></td></tr><tr><th scope="row" class="navbox-group" style="width:1%">Other</th><td class="navbox-list-with-group navbox-list navbox-odd" style="width:100%;padding:0"><div style="padding:0 0.25em"><ul><li><a rel="nofollow" class="external text" href="https://www.idref.fr/027234908">IdRef</a></li><li><a rel="nofollow" class="external text" href="https://lux.collections.yale.edu/view/concept/08f8e345-e0c7-4df6-a5a2-394e8a317dbc">Yale LUX</a></li></ul></div></td></tr></tbody></table></div></div><div><div class="zim-footer">

This article is issued from <a class="external text" title="Last edited on 2025-07-24" href="https://en.wikipedia.org/wiki/?title=Distributed_computing&oldid=1302287877">Wikipedia</a>. The text is available under <a class="external text" href="https://creativecommons.org/licenses/by-sa/4.0/deed.en">Creative Commons Attribution-Share Alike 4.0</a> unless otherwise noted. Additional terms may apply for the media files.

</div>

</div></div>

</div>

</main>

</div>

</body></html>